Program additional data processing device, server apparatus, program information display method, and recorded medium

ABSTRACT

A program ancillary data processing apparatus is provided which includes a program ancillary data extraction unit for extracting program ancillary data pertinent to commodities or services appearing in each scene, from picture program data, and a display control unit for displaying, on a display picture, the information relevant to the commodities or services appearing in each scene, and the sum total of the number of times of scene-based access events by the audience to a database supervising the detailed information relevant to the commodities or services, based on the preset layout information.

TECHNICAL FIELD

This invention relates to a program ancillary data processing device ina digital picture program receiving reproducing system, a server device,a program information displaying method and a recording medium.

BACKGROUND ART

In certain programs aimed to sell goods (so-called television shopping),the viewer's will to purchase goods can be communicated to a serverthrough a telephone network or the like up link. In this sort of theprogram, services can be rendered by embedding the ancillary informationnecessary in purchasing the commodities, inclusive of the telephonenumber for connection to the server in making an offer for purchase, ina gap of the analog broadcast waves. However, with the currentlyoperating broadcast system, it is not possible to supply a sufficientamount of the information to the viewer because of constraint in e.g.,the signaling system. However, in the digital broadcast system, as usedin the next-generation broadcast system, in which an appreciably largequantity of the information can be transmitted, there is a good prospectfor realization of variegated services employing the program ancillarydata. For example, there is a good prospect for realization not only ofan interpolating service of checking for a singer's profile as the songprogram on air is viewed, but also of a bidirectional service of placingan order for commodities presented on a display picture as a pictureprogram on air is viewed.

However, even if the amount of the information acquired is increased,but the access to the required information is not facilitated, it is notpossible to render attractive services for the viewer.

DISCLOSURE OF THE INVENTION

In view of the above problems, the present invention is aimed to providea program ancillary data processing device, a server device, a programinformation displaying method and a recording medium in a digitalpicture program receiving and reproducing system, in which the access bythe viewer to the information is facilitated. For solving the aboveproblem, the following means are proposed. Meanwhile, a receivingreproducing system for digital picture programs may be constructed whichgives rise to variegated user friendliness depending on the combinationsused. Of course, an on-line shopping system can be constructed byinterconnection to the external database over a network. Meanwhile, theundermentioned respective means do not have to be mounted in theterritory of the same nation at the time of the network systemconstruction. As for recording mediums, by optionally combining theundermentioned means, such a recording medium may be realized whichgives rise to variegated user friendliness depending on the combinationsused.

The functional units, forming the undermentioned means, may beimplemented as hardware or as software.

As first means, the present invention proposes a program ancillary dataprocessing apparatus including a program ancillary data extraction unitfor extracting program ancillary data relevant to commodities orservices appearing in each scene, from picture program data, and adisplay control unit for displaying, on a display picture, theinformation relevant to the commodities or services appearing in eachscene, and the sum total of the number of times of scene-based accessevents by the audience to a database, which supervises the detailedinformation relevant to the commodities or services, based on the presetlayout information.

With use of this program ancillary data processing device, in which thedegree of interest the audience at large feels in commodities orservices appearing in a picture program can be checked on the scenebasis, with the number of times of browsing of the detailed informationand the number of offers for purchase, as indices, it can be readilyconfirmed whether the commodities or services contained in a scene arepopular ones. In particular, the device can be used effectively forbrowsing program ancillary data for many scenes.

The ‘program ancillary data’ may encompass not only data received over atransmission path, but also data reproduced from a recording medium.Meanwhile, the recording medium may be the picture program received,reproduced and recorded by the user, in addition to the recording mediumoffered to the market as it has the picture program data pre-recordedthereon. If the picture program data has been received over atransmission route, the receiving device for picture program data may beprovided in the same casing as that for a program ancillary dataprocessing device, or may be provided as a separate device in a separatehousing. In case the picture program data is available over thetransmission route, the latest value of the number of times of accessevents can be demonstrated substantially in real-time.

As for the transmission route, it does not matter whether thetransmission route is a wired path, such as copper wire or opticalfiber, or a radio route, such as short wave, ultra-short wave,micro-wave or infrared light. As for the transmission system, it doesnot matter whether the system is a broadcast system or an interactivetransmission (distribution).

If the picture program data is reproduced from a recording medium, thereproducing system for reproducing picture program data may be providedin the same casing as that for the program ancillary data processingdevice, or provided as a separate device provided in a separate casing.When the picture program data is reproduced from the recording medium,there is a time difference between the time of recording the number oftimes of access events displayed and the time of reproducing the numberof times of access events displayed, so that the latest value cannot befurnished in real-time. However, the number of times of access eventsdisplayed can be used as a more or less reliable measure.

Meanwhile, if the correct information is to be demonstrated in case ofusing the system of reproducing the information from a recording medium,it may be contemplated to access the database supervising the pictureprogram data in question, over a separate communication network, toreceive the latest number of times of access events.

As the recording medium, a CD-ROM, a medium of the magnetic recordingsystem, such as magnetic tape, floppy disc, hard disc or magnetic card,an optical recording type medium, such as write-once CD, DVD or anoptical card, a magneto-optical recording type medium, such as DVD, MDor MO, or a semiconductor memory, such as non-volatile memory or RAM,may be used.

The ‘scene’ may be a spot, shot, a frame or a field. The ‘informationrelevant to commodities or services’ may, for example, be a brand name,a category name of a commodity, name of a commodity or service, name ofa producer, name of a supplier of commodities or services, contact site,such as URL, an e-mail number or a telephone number, or charges. Theinformation may, of course, be a combination of part of theseinformation, without encompassing all of the above information.

The ‘detailed information relevant to the commodities or services’ mayinclude, for example, the name of the furnishing business operator, aselling business operator, a possible site of purchase or furnishment,time period, reserve, furnishing time period, terms of delivery,remuneration, conditions of payment, commodities, body color sorts orservice image information, and detailed legends. The information may, ofcourse, be a combination of part of these information, withoutencompassing all of the above information.

Meanwhile, if the GPS information is included in the above information,it may be associated with a map database so as to be used in grasping,at the outset, the site of possible purchase on a display picture. Ofcourse, one can arrive at a destination, without getting lost, bydelivering the position information to a car-laden GPS receiver viae.g., a recording medium.

The superintendent of the ‘database’, which supervises these detailedinformation, may be a producer or a distributor of a recording medium ora business undertaker, operating as an intermediary for purchasingcommodities or services, in addition to the producer, broadcaster ordistributor of picture programs. The ‘database’ is not simply theinformation supplier, but may also be a supplier for an on-line shoppingfunction. At any rate, it is sufficient if the ‘database’ has in storethe information which allows to grasp the correlation of the informationin store with respect to the commodities or services appearing as animaged object in a picture program by computerized data processing.

The ‘number of times of access events by the audience’ may be theinformation relevant to the summation of the number of times of accessevents which failed to led to purchase and the number of times of accessevents which led to purchase, or the information relevant to one ofthese two numbers of times of access events.

The ‘results of the summation of scene-based access events’ encompassnot only a case in which the number of times of access events is countedin a counter designed for counting the number of times of access events,based on the information received by the program ancillary dataprocessing device, using the number of times of access events to theindividual commodities or services, but also a case in which the numberof times of access events is already counted in a sending or recordingside of the program ancillary data and received as program ancillarydata. Which of these systems is adopted depends on the transmissionformat or on the recording format. The information may also be acquiredseparately over a communication network.

The ‘layout information’ may be included as part of the picture programdata, for example, as the tag information of the picture descriptionlanguage, or may be saved apart from the picture program data by theprogram ancillary data producing device, for example, as the templateinformation. Meanwhile, this ‘layout information’ may or may not includethe information for correlation with an index picture for acorresponding scene. If the correlation information is included, anindex picture for a corresponding scene may be demonstrated asnecessary.

The terminal operating as this ‘program ancillary data processingdevice’ may include computer terminals, such as notebook or desktoppersonal computers, PDA, portable telephone sets, game machines, set topboxes, PC card, domestic electrical utensils, VTR, television receivers,car navigation systems, wrist watches having the information processingfunctions, distribution terminals for music or games, financialterminals (ATM) etc, in addition to dedicated terminals for processingthe program ancillary data. The same applies for the program ancillarydata processing devices that follow.

As second means, the present invention proposes a program ancillary dataprocessing apparatus including a program ancillary data extraction unitfor extracting program ancillary data relevant to commodities orservices appearing in each scene, from picture program data, and adisplay control unit for displaying the information relevant to thecommodities or services appearing in each scene, and the sum total ofthe number of times of commodity-based or service-based access events bythe audience to a database, supervising the detailed informationrelevant to the commodities or services, on a display picture, based onthe preset layout information.

This second means is similar to the first means except that the resultsof summation of the number of times of accessing events by the audienceon the commodity or service basis are demonstrated on the displaycontrol unit. Thus, with use of this program ancillary data processingdevice, the degree of interest of the audience at large feels incommodities or services appearing in a picture program can be checked onthe scene basis, with the number of times of browsing of the detailedinformation and the number of offers for purchase as indices, so that itcan be readily confirmed whether the commodities or services containedin a scene are popular ones. For example, this means is convenient incase limitations are imposed on the possible number of offers forpurchase or of items that can be purchased.

The ‘results of summation on the commodity or service basis’ are usuallycalculated on the sending side or recording side of picture programdata. These information not only may be read out from the programancillary data but also may be acquired over a separate communicationnetwork. Meanwhile, the explanation on other terms common to theabove-described means is the same as that for these means.

In the above explanation, the function for implementing the first meansand the function for implementing the second means are mountedseparately. These functions may, however, be loaded on one device. Thatis, the function of displaying the results of summation on the scenebasis and that of displaying the results of summation on the commodityor service basis may be loaded on one and the same device.

As third means, the present invention proposes a program ancillary dataprocessing device of the first or second means wherein the results ofsummation of the number of times of scene-based access events, thesummation of the number of times of commodity-based access events andthe summation of the service-based access events from the audience tothe database, which supervises the detailed information on thecommodities or services, are acquired as program ancillary data of thepicture program data.

This program ancillary data processing device, in which the targetedinformation on the number of times of access events is acquired from theprogram ancillary data received or reproduced with the picture program,is convenient as a device not carrying communication means. It should benoted that, if the device includes communication means, the time untildisplay of the relevant information can be shortened by acquiring theinformation on the number of times of access events from the so receivedor reproduced program ancillary data.

Meanwhile, the explanation on other terms common to the above-describedmeans is the same as that for these means.

As fourth means, the present invention proposes a program ancillary dataprocessing device of the first or second means wherein the results ofthe scene-based summation, commodity-based summation or theservice-based summation of the numbers of times of access events by theaudience to the database supervising the detailed information pertinentto the commodities or services are acquired, apart from the pictureprogram data, from the database which is connected to the device over acommunication network and which supervises the detailed information onthe commodities or services.

This program ancillary data processing device, in which the informationon the number of times of access events can be acquired over acommunication network, apart from the picture program data, is able tofurnish the latest number of times of the access events at all times tothe audience, not only for the case in which the contents of the programancillary data are confirmed simultaneously with the progress in thedisplay of the picture program but also for the case in which thepicture program data transiently stored is reproduced or in which thepicture program data distributed as the recording medium is reproduced.

It does not matter whether the ‘communication network’ is a wired pathor a radio path. Meanwhile, the explanation on other terms common to theabove-described means is the same as that for these means.

As fifth means, the present invention proposes a program ancillary dataprocessing device including a program ancillary data extraction unit forextracting, from picture program data, program ancillary data relevantto commodities or services appearing in each scene, and a displaycontrol unit for displaying the information relevant to the commoditiesor services appearing in each scene, on a display picture, along with anindex picture of a corresponding scene, based on the preset layoutinformation.

With use of this program ancillary data processing device, the audienceis able to confirm the contents of each scene forming the pictureprogram, in particular the contents of the commodities or servicesprovided by the program ancillary data, as he or she compares them withthe display on the index picture.

Meanwhile, if the program ancillary data is displayed at the same timeas the picture program is displayed, similar objectives may be achievedfrom the display of the picture program. However, since the indexpicture is usually displayed as a still picture, in distinction from thepicture program, the information required may advantageously beconfirmed at a slow pace.

Of course, if only the contents of the program ancillary data are to bedisplayed, apart from the display of the picture program, the contentsof a scene may be confirmed from the index picture, even if the userrelies on his or her memory, so that the user is able to view only thepicture program itself, while he or she may confirm the contents of theprogram ancillary data at a slow pace after the end of the pictureprogram. This means releasing the audience from the viewing timeconstraint.

As the ‘index picture’, a typical frame picture of a corresponding scenein general is used. The index picture may, for example, be a leadingframe of a relevant scene, a frame which allows for easy recognition ofcommodities or services, such as a frame decided on by a producer or bythe audience, or a trailing frame of the relevant scene. Meanwhile, theindex picture is desirably a picture taken out or generated from thepicture program, for confirming the contents of the scene, and may alsobe a computer picture or an icon that allows for discrimination ofeffect sounds (theme songs, inserted songs and BGM). In the case of theeffect sounds, a frame picture of a scene employing the effect sounds oran image picture of the music sound may similarly be used.

Although the index picture is a still picture, as a principle, the indexpicture may also be provided with a moving picture reproducing functionin order that the audience is able to be readily reminded of thecontents of the relevant scene. The moving picture reproducing functiondoes not have to be the full picture size reproducing function, suchthat the reproducing function of a simplified picture having a reducedpicture size or having the number of pixels reduced on decimationsuffices. The reproducing speed may be such as permits variable speedreproduction. The index picture may be provided with the music soundreproducing function. This reproducing function does not have to bemusic sound reproduction throughout the entire scene such thatreproduction of the music sound of the representative portion may besufficient. The reproduction may also be variable speed reproduction.

If the display function of the index picture in the present means andthe function of displaying the number of times of access events,explained in connection with the above-described means, are combinedtogether, compound effects may be derived. Meanwhile, the explanation onother terms common to the above-described means is the same as that forthese means.

As the sixth means, the present invention provides the fifth meanswherein the index picture is given as program ancillary data for thepicture program data.

With use of this program ancillary data processing device, in which theindex picture does not have to be prepared in the device itself, theprocessing resources necessary for carrying out the processing can beallocated to other processing operations. In such case, there areprovided on the audience side an index picture extraction unit and astorage unit for storing the extracted index picture.

In particular, if the considerable processing capability is required inthe preparation of an index picture, or if significant instabilities inthe processing capability are predicted to be produced in a receivingterminal or in a reproducing terminal, it is desirable to prepare anindex picture at the outset and to have the so prepared index pictureincluded in the program ancillary data.

Meanwhile, the explanation on other terms common to the above-describedmeans is the same as that for these means.

As seventh means, the present invention proposes the fifth means whereinthe index picture is created on the audience side from picture data ofpicture program data.

With use of this program ancillary data processing device, in which theindex picture is prepared within the device itself, it is onlysufficient if the index picture as required in case of necessity isprepared, while it is possible to evade the risk of an abundantrecording area being consumed by the index picture of the major portionof program ancillary data that does not have to be confirmed. Since theindex picture does not have to be included in the picture program datain such case, the amount of data transmitted or recorded can be reduced,thus reducing the amount of data transmitted or recorded. In this case,an index picture former is provided on the audience side.

It is noted that the program ancillary data processing device may beadapted to prepare an index picture only when the program ancillary dataincludes the information on the commodities or services, in which casethe decision unit for discriminating the presence/absence of theinformation in question is provided on the audience side and thepermission to prepare an index picture is given the index pictureforming unit only when there exists the information on the commoditiesor services. Alternatively, the index picture may be preparedirrespective of the presence or absence of the relevant information.

For specifying a picture used as an index picture, the information setat the outset in the device itself may be used, in which case theinformation is set on the recording medium having stored the positioninformation. Alternatively, the picture may be specified by programancillary data, in which case there is provided a position specifyinginformation readout unit.

Meanwhile, the explanation on other terms common to the above-describedmeans is the same as that for these means.

As eighth means, the present invention proposes the seventh means wherethe index picture has been produced from a scene optionally selected bythe viewer.

With use of this program ancillary data processing device, not the indexpicture in which commodities or services relevant to program ancillarydata appear in an averaged out manner, but a picture which permitsfacilitated recognition of the commodities or services the audienceintends to confirm can be selected as an index picture, so that thepicture selected may be convenient for the viewer.

It should be noted that an input accepting unit for a scene position asselected by the viewer, sometimes including the position information forthe relevant scene, a recording unit for recording the input positioninformation and an index picture former are provided on the viewer side.

Meanwhile, the explanation on other terms common to the above-describedmeans is the same as that for these means.

As ninth means, the present invention proposes a program ancillary dataprocessing device including a program ancillary data extraction unit forextracting program ancillary data relevant to commodities or servicesappearing in each scene, from picture program data, and a displaycontrol unit for displaying the information relevant to plural scenes,as extracted, based on the layout information for list type display.

With use of this program ancillary data processing device, in whichaccess to the information relevant to plural scenes can be made on onepicture, it is possible to evade the laborious operation of confirmingthe contents from one scene to another. Moreover, since the informationof plural scenes can be compared to one another on the same picture, thetargeted information can be accessed more readily.

The file for list type display, such as a list file, may or may not becontained at the outset in the ‘program ancillary data’. In the formercase, it is sufficient if the file designed for list type display isread out and displayed, whereas, in the latter case, it is sufficient ifthe file for list type display is formed on the basis of the informationfor each scene. A list file former is provided on the viewer side.

It should be noted that the range of plural scenes displayed in a listform may be afforded as a part of the program ancillary data, ordetermined under the commands of the program ancillary data processingdevice, that is under the commands by the viewer.

In the latter case, an automatic list range decision unit may beprovided with the function of setting plural scenes, lying ahead and atback of a scene the viewer has requested to be displayed in a list form,as a display range. Alternatively, the automatic list range decisionunit may be provided with plural scenes previous to the scene the viewerrequested to be displayed in a list form (past scenes already displayed)or plural scenes subsequent to the scene the viewer requested to bedisplayed in a list form (scenes not yet displayed). Meanwhile, theautomatic list range decision unit may be provided with a functionwhich, when the viewer has specifically indicated the range (the startposition and the end position), sets the so specified range as thedisplay range.

In general, the range of plural scenes may be the whole program,encompassing the entire scenes, or several scenes, such as two or threescenes. This range may be given as program ancillary data orautomatically determined under the command given by the programancillary data processing device. These ranges may or may not beoverlapped with one another.

On the other hand, the ‘layout information’ may be included as part ofthe picture program data, or saved in the program ancillary dataprocessing device independently of the picture program data. Meanwhile,this ‘layout information’ may or may not include the information ofcorrelating the relevant scene with its index picture.

Meanwhile, the explanation on other terms common to the above-describedmeans, such as ‘program ancillary data processing device’, is the sameas that for these means.

As tenth means, the present invention proposes the ninth means whereinthe display control unit has the function of displaying the informationrelevant to commodities or services appearing in each scene, along withan index picture of a corresponding scene, on a display picture.

With use of this program ancillary data processing device, the viewer isable to confirm the contents of the respective scenes making up apicture program, in particular the contents of commodities or servicesgiven by the program ancillary data, based on the display on the indexpicture. Thus, anyone (from children to aged people) may easily find outthe scene of interest from the plural scenes displayed in a list form.Moreover, ease in use for the viewer is improved appreciably because heor she is able to confirm the contents of the commodities or servicesappearing in the so specified scene as he or she compares the contentswith those shown in the associated scene. Meanwhile, the advantagederived from the use of the index picture is the same as that in theabove means. The site in which to create an index picture is also asexplained in connection with the above means.

It is noted that the explanation on other terms common to theabove-described means is the same as that for these means.

As the eleventh means, the present invention proposes the ninth meanswherein scenes of the picture program to be processed are extracted ingroups composed of a preset number of scenes, in the order in which theyare displayed, based on the layout information, for presentation asplural scenes for the viewer in a list form.

With use of this program ancillary data processing device, the scenesdisplayed in the list form are necessarily contiguous to one another, sothat anyone (from children to aged people) may easily access the targetscene. Meanwhile, the ‘preset number’ may be included in the programancillary data, or may be set or changed on the viewer side. In thelatter case, a recording unit is provided on the viewer side forrecording the number of scenes usable at the time of display in the listform.

The expression ‘in groups composed of a preset number of scenes, in theorder in which they are displayed’ does not mean that the presentationof partially common scenes between a scene included in given results ofextraction and a scene included in the next or previous results ofextraction is to be excluded.

It is noted that the explanation on other terms common to theabove-described means is the same as that for these means.

As twelfth means, the present invention provides the ninth means whereinscenes of the picture program to be processed are optionally commandedfor selection by the viewer and extracted in groups composed of a presetnumber of scenes, based on the layout information, for presentation asplural scenes for the viewer in a list form.

With use of the program ancillary data processing device, only thescenes are displayed which have been selected by the viewer with anintention of confirming them. This enables the viewer to access thenecessary scene easily in a short time. Meanwhile, if the volume of theinformation correlated with the respective scenes is increased, ease inaccessing the scene desired to be confirmed may be lost, even althoughconvenience for the user is increased. Thus, with use of the device, itis possible to render services convenient to use for anyone (fromchildren to the aged). In the present device, a recording unit forrecording the number of scenes at the time of display in a list form isprovided on the viewer side.

It is noted that the explanation on other terms common to theabove-described means is the same as that for these means.

Meanwhile, if the ninth to twelfth means are combined with the functionof displaying the number of times of access events, there may beprovided a confirmation picture of the program ancillary data which ismore convenient to use for the viewer. If, in displaying plural scenesin a list form, an index picture is afforded to each scene, and thenumber of times of scene-based access events or that of the commodity-or service-based access events is displayed, the scene targeted or thescene in which the detailed information is desired to be confirmed canbe determined easily.

In each of the first to twelfth means, explanation has been made on thepremises that the program ancillary data pertinent to the commodities orservices appearing in each scene are supplied through picture programdata. Alternatively, these data may also be acquired from an externaldatabase over a communication route, as indicated in thirteenth means.

As the thirteenth means, the present invention proposes a programancillary data processing apparatus including an extraneous datapresence/absence detection unit for extracting, from picture programdata, data indicating whether or not the information relevant tocommodities or services appearing in each scene is available through anexternal database, and for detecting the presence/absence of theextraneous data based on the so extracted data, a downloading unit fordownloading, when an access request to extraneous data is made by anoperating input by the viewer, a list file provided from the outset forpresenting the information relevant to plural scenes to the viewer in alist form, from an external database, and a display control unit foropening the downloaded list file for displaying the information relevantto the plural scenes involved in the list file on a display picture in alist form, based on the preset layout information. The list file is aninformation file provided from the outset for a relevant pictureprogram,

With the present program ancillary data processing device, a picturesimilar to that of the ninth means may be provided to the viewer if theinformation relevant to commodities or services appearing in each sceneis not included in the program ancillary data, but there is containeddata indicating whether or not the information relevant to commoditiesor services appearing in each scene is available through an externaldatabase, and the data indicates availability of the information fromthe external database. That is, access to the information relevant toplural scenes can be made in one picture to dispense with the labor inperforming similar operations from scene to scene. Moreover, access tothe target information can be facilitated because the information forplural scenes can be contrasted to one another on the same picture.

Meanwhile, this service configuration has high affinity with chargeableservices. That is, services can be rendered only to users desirous tohave more detailed information furnished to them. In addition, sinceonly a small amount of the supplementary information to programancillary data suffices, this service configuration can co-exist withservices at large.

The ‘external database’ may be enumerated by a producer or a distributorof the recording medium, business undertakers acting as intermediary forpurchasing the commodities or services, in addition to producers,broadcasters and distributors of the picture program. This database mayalso furnish the on-line shopping function, without being limited tosimply furnishing the information relevant to commodities or services.

The ‘data indicating availability’ may, for example, be data representedby a flag or plural bits for specified addresses. The ‘list file’indicates a set of program ancillary data for each of the plural scenesbelonging to the scene range in question.

Meanwhile, the plural scenes making up the ‘list file’ may be providedat the outset by the database superintendent or may be decided onresponsive to the viewer's selection. In this case, the range selectedby the viewer is notified to the database over a communication route.These scenes may also be those extracted at a rate of a preset number inthe order in which these scenes appear in the picture program.

The ‘preset layout information’ may be supplied from the database alongwith the list file, or saved at the outset in the program ancillary dataprocessing device. The layout information saved in the program ancillarydata processing device may be previously supplied from the database, orsaved as from the time of shipment of the program ancillary dataprocessing device.

The layout information may or may not include the informationcorrelating the information with the index picture for the correspondingscene. The ‘correlating information’ may be the recording addresses,file numbers and so forth.

The terminal operating as this ‘program ancillary data processingdevice’ may include computer terminals, such as notebook or desktoppersonal computers, portable information terminals (PDAs), portabletelephone sets, game machines, set top boxes, PC cards, domesticelectrical utensils, VTR, television receivers, car navigation systems,wrist watches having the information processing functions, or remotecontrollers, in addition to the dedicated devices for processing programancillary data.

Meanwhile, the explanation on other terms common to the above-describedmeans is the same as that for these means.

As the fourteenth means, the present invention proposes a programancillary data processing device including a downloading unit forcommunication with another terminal device for downloading theinformation which is relevant to commodities or services appearing ineach scene, and which is program ancillary data of a picture program inquestion, from a recording medium supervised by another terminal device,and a display control unit for demonstrating, on a display picture, theinformation relevant to commodities or services appearing in each scene,responsive to an operating input by an operator.

With use of this program ancillary data processing device, programancillary data received or reproduced by another terminal device andstored on a recording medium may be separately taken out for re-use. Forexample, program ancillary data received and stored in a TV receiverhaving the storage function may be downloaded to confirm its contents.In particular, the program ancillary data processing device may be usedfor such application in which program ancillary data stored in astandstill terminal device is transferred by a user to a portableprogram ancillary data processing device for confirming the storedinformation when the user is out, or in which the user makes on-lineshopping based on the so confirmed information.

It is of course possible with a portable program ancillary dataprocessing device to directly receive or reproduce program ancillarydata or to download the program ancillary data directly from an externaldatabase. However, in view of the currently available device in whichthe communication speed with radio waves, felt to be a mainstream in theportable device, is insufficient, or limitations are imposed on therecording capacity, the demand from the user is thought to be high.Although this technical task will be solved in future, it is meritoriousto selectively capture only data required by the viewer, inconsideration of the labor involved in reaching the target data fromamong the voluminous data.

The terminal operating as this ‘program ancillary data processingdevice’ may include computer terminals, such as notebook or desktoppersonal computers, portable information terminals (PDAs), portabletelephone sets, game machines, set top boxes, PC cards, domesticelectrical utensils, VTR, television receivers, remote controllers, carnavigation system and wrist watches having the information processingfunctions, in addition to the dedicated devices for processing programancillary data. However, if the application in this means is taken intoconsideration, a standstill type device is thought to be customary.

As for the ‘recording medium’, it may not only be enclosed in anotherdevice, but also mounted externally on such other device, provided thatthe recording medium is supervised by such other device. The recordingmedium may be a CD-ROM, a medium of the magnetic recording system, suchas magnetic tape, floppy disc, hard disc or magnetic card, an opticalrecording type medium, such as write-once CD, DVD or optical cards, amagneto-optical recording type medium, such as DVD, MD or MO, or asemiconductor memory, such as non-volatile memory or RAM.

Meanwhile, the ‘information relevant to commodities or servicesappearing in each scene’ may include the sum total of the number ofscene-based access events from the viewer to the database, whichsupervises detailed information concerning the commodities or servicesin question. The ‘information relevant to commodities or servicesappearing in each scene’ may also include the sum total of the number ofcommodity-based or scene-based access events from the viewer to thedatabase which supervises detailed information concerning thecommodities or services in question. In this case, these information maybe acquired from other terminal devices or directly downloaded from thedatabase which supervises the information. The ‘information relevant tocommodities or services appearing in each scene’ may include indexpictures associated with respective scenes.

The ‘program ancillary data processing device’ for downloading data fromanother terminal may include computer terminals, such as notebook ordesktop personal computers, portable information terminals (PDAs),portable telephone sets, game machines, set top boxes, PC cards,domestic electrical utensils, VTR, television receivers, remotecontrollers, car navigation systems and wrist watches having theinformation processing functions, in addition to the dedicated devicesfor processing program ancillary data. However, if the application inthis means is taken into consideration, a standstill type device isthought to be customary. Although it is desirable that the ‘programancillary data processing device’ has a display device enclosed therein,it is sufficient if the contents are displayed on the display deviceeven if the display device is not enclosed.

Meanwhile, the explanation on other terms common to the above-describedmeans is the same as that for these means.

As the fifteenth means, the present invention proposes the fourteenthmeans wherein the display control unit has the function of presentingthe information relevant to plural scenes to the viewer in a list formbased on the preset layout information.

With use of this program ancillary data processing device, in which theinformation relevant to plural scenes can be confirmed at a time on thedisplay picture, there is no necessity of performing the operation ofdemonstrating the information of another scene even when the informationconcerning a given scene does not include the target information. As aresult, the retrieval is more effective than in the case of accessingeach scene separately. Meanwhile, the list-form picture may bedownloaded from another terminal device, or produced in the programancillary data processing device.

The number of times of scene-based access events or that of commodity-or service-based access events may be demonstrated for each of thescenes displayed in a list form. Similarly, the index picture may bedemonstrated in association with each scene. In this case, theseinformation can be directly downloaded from an external database.

Meanwhile, the function of the fifteenth means may be provided byitself, instead of as a combination with the fourteenth means.

It is noted that the explanation on other terms common to theabove-described means is the same as that for these means.

As the sixteenth means, the present invention provides a programancillary data processing apparatus for displaying the informationrelevant to commodities or services appearing in each scene, on adisplay picture, based on program ancillary data extracted from pictureprogram data, in which the apparatus includes a display control unit fordisplaying an index picture of a scene, in an imaged object of which areincluded commodities or services selected with a will for purchasing, ina correlated fashion in a basket picture in which the contents of thecommodities or services selected can be confirmed prior to finaldecision of transaction.

With use of this program ancillary data processing device, when thecommodities or services scheduled to be purchased on a basket displaypicture are re-confirmed, it is possible to make a re-check of thecommodities or services on an index picture. As a result, the labor ofexiting the index picture to move to the other picture only for thepurpose of confirming the contents of the commodities or services may bedispensed with. In particular, when the commodities being confirmed onthe basket picture affect several scenes, it is unnecessary to return toeach scene. This gives a confirmation picture convenient to use readilyby anyone.

Meanwhile, the number of times of scene-based access events or thenumber of times of commodity- or service-based access events can bedisplayed on the basket picture. If this function is combined with theabove function, the commodities or services can be checked forpopularity among other users without the necessity of moving from onepicture to another picture.

Although the case of displaying the index picture on the basket picturehas been explained in connection with the present means, it may becontemplated to display only the number of times of scene-based accessevents or only the number of times of commodity- or service-based accessevents on the basket picture.

Meanwhile, the basket information may be managed by the viewer terminalor by the terminal of the server acting as an intermediary for thesponsorship transaction. When the basket information is managed by theterminal on the viewer side, the information concerning the commoditiesor services the viewer has had the intention to purchase is transmittedto the server side at a stage when the will for purchase isre-confirmed.

Meanwhile, the present program ancillary data processing device can beused irrespective of whether the device is of portable type or of astandstill type. That is, the device may be a computer terminal, such asnotebook or desktop personal computer, a portable information terminal(PDA), a portable telephone set, a game machine, a set top box, a PCcard, domestic electrical utensils, VTR, a television receiver, a carnavigation system, a wrist watch having the information processingfunctions, or a remote controller, in addition to the devices dedicatedto the processing of program ancillary data.

It is noted that the explanation on other terms common to theabove-described means is the same as that for these means.

As the seventeenth means, the present invention proposes a server deviceincluding an access information acquisition unit for acquiring theinformation pertinent to the access state from the viewer to a databasesupervising the detailed information pertinent to commodities orservices appearing as an imaged object in a picture program, inaccordance with a request from the viewer connected to the acquisitionunit over a communication network, and a communication functional unitfor notifying the latest value of the number of times of scene-basedaccess, as acquired by the access information acquisition unit, and asrequested by the viewer.

With use of this server device, it is possible to render services usingthe information concerning the access state from the viewer to thedetailed information pertinent to commodities or services even when suchinformation is not included in the picture program data received orreproduced by the viewer. Since the information supplied here is thenumber of times of scene-based access events, the viewer is able tojudge whether or not popular commodities or services are contained inthe scene in question. This information also proves beneficial to thebusiness undertaker who furnished the commodities or services to theprogram or brokerage business operator acting as intermediary for thesponsorship transaction between the viewer and the business undertaker.

Meanwhile, the ‘database supervising the detailed information’ not onlymay be a producer, a broadcaster or a distributor of the picture programbut also may be a producer or a distributor of a recording medium or abusiness undertaker acting as an intermediary for purchasing thecommodities or services. Meanwhile, the database superintendent may bethe same as or different from the server device superintendent. Ofcourse, the database may be provided in the server device itself, or maybe connected to the server device over a network.

The ‘information pertinent to the access state’ may be the informationcorresponding to the sum of the number of simple accesses to thedetailed information pertinent to commodities or services which failedto lead to purchase and the number of times of access events which ledto purchase. Alternatively, it may be the information pertinent to onlyone of the above two numbers of times of access events.

The ‘viewer’ may be limited to the specified viewer who has concludedservice contracts, whether chargeable or non-chargeable, with thesuperintendent of the server device, or to the entire viewers that canbe connected to the server device over a communication network.

The ‘server device’ simply has the meaning that the device operates as aserver device with respect to the viewer terminal, and may be a computerterminal (notebook or desktop computer), a portable information terminal(PDA), a portable telephone set, a game machine, a set top box, a PCcard, a car navigation system, a wrist-watch having the informationprocessing function, and so forth, in addition to a dedicated serverdevice.

It is noted that the explanation on other terms common to theabove-described means is the same as that for these means.

As the eighteenth means, the present invention proposes a serverincluding an access information acquisition unit for acquiring theinformation pertinent to the access state from the viewer to a database,which supervises the detailed information pertinent to commodities orservices appearing as an imaged object in a picture program, inaccordance with a request from the viewer connected to the acquisitionunit over a communication network, and a communication functional unitfor notifying the latest value of the number of times of commodity-basedor scene-based access, as acquired by the access information acquisitionunit, and as requested by the viewer.

The difference between this server device and the server device of theseventeenth means is that the information furnished is the latest valueof the number of times of commodity- or service-based access events ineach scene.

Thus, with this means, the latest value of the access states from theviewer to the detailed information pertinent to commodities or servicesappearing as an imaged object in the picture program can be incidentallysupplied on request from the viewer. Meanwhile, since the informationfurnished here is the number of commodity- or service-based accessevents for commodities or services appearing as an imaged object in eachscene, the viewer is able to judge easily which is the commodity orservice now in vogue. This information also proves beneficial to thebusiness undertaker who furnished the commodities or services to theprogram or brokerage business operator acting as intermediary for thesponsorship transaction between the viewer and the business undertaker.

Meanwhile, the explanation on other terms common to the above-describedmeans is the same as that for these means.

It should be noted that, if the seventeenth means is combined with theeighteenth means, such a server device may be realized which is able tofurnish the latest value of the number of times of scene-based accessevents and the latest value of the commodity- or service-based accessevents of the scene in question simultaneously.

As nineteenth means, the present invention proposes a server deviceincluding an information furnishing unit for accessing a databasesupervising the detailed information relevant to commodities or servicesappearing as an imaged object in a picture program, responsive to arequest from the viewer connected to the information furnishing unitover a communication network, for furnishing a list file provided forpresenting the information relevant to plural scenes in a list form tothe viewer. The list file is an information file provided for therelevant picture program.

With use of this server device, if an information file in question isnot included in the picture program data received or reproduced by theviewer, it is possible to enjoy services employing such file.

For each of the ‘database’, ‘viewer’ and ‘server device’, what has beensaid of the database in the seventeenth or eighteenth means holds.

Meanwhile, the ‘list file’ may already exist in the database, or may beprepared by the server device based on the information supervised in thedatabase. The range of the plural scenes making up the ‘list file’ maybe decided on responsive to the setting by the superintendent of thedatabase or the server device or an optimum value of the range may beprovided responsive to the viewer's demand. Of course, the range can beautomatically set based on a predetermined setting rule (rule similar tothat for the aforementioned program ancillary data processing device).Meanwhile, the ranges of the plural scenes making up the list file mayor may not be overlapped with one another.

Meanwhile, the ‘list file’ usually includes or is paired with the layoutinformation. However, the layout information may not be furnished fromthe server device, in which case the display on the viewer side is basedon the layout information provided on the viewer side.

It is noted that the explanation on other terms common to theabove-described means is the same as that for these means.

Of course, the server device of the present nineteenth means may becombined with the function of furnishing the number of times of accessevents in the seventeenth or eighteenth means. When the seventeenthmeans and the nineteenth means are to be combined together, the numberof times of access events from one scene of the list file to anothermust be able to be furnished along with the list file. When theeighteenth means and the nineteenth means are to be combined together,the number of times of access events from one commodity or service foreach scene of the list file to another must be able to be furnishedalong with the list file. Of course, the seventeenth means can becombined with the eighteenth means.

As the twentieth means, the present invention proposes the nineteenthmeans wherein the information furnishing unit has the function offurnishing an index picture associated with a scene in question for eachscene forming the list file.

With use of this server device, such a list file, each scene of whichincludes an index picture, can be provided. Since the index picture isattached to each of the scenes making up the list file, the operation ofscene retrieval by the viewer is facilitated.

Meanwhile, the ‘index picture’ may not only be provided on the sidedatabase but on the side server device.

It is noted that the explanation on other terms common to theabove-described means is the same as that for these means.

As the twenty-first means, the present invention provides a pictureinformation displaying method for displaying, on a display picture, theinformation pertinent to commodities or services appearing in each sceneof a picture program, responsive to a request from the viewer, in whichthe method includes a processing step of reading out the results ofsummation of the number of times of scene-based access events of theviewer to a database, which supervises the detailed information relevantto commodities or services appearing in a scene to be displayed, and aprocessing step of displaying the read-out results in association withthe scene in question.

With use of the program information displaying method, the viewer isable to judge readily whether or not popular commodities or services areincluded in a scene on the display picture, in which the viewer isinterested, without regard to the route of acquisition of theinformation on the number of times of access events. In particular, themethod is useful if, in browsing the information on the commodities orservices appearing in imaged objects in many scenes, a decision is to begiven as to for which scene the information to be browsed.

Meanwhile, the route of acquisition of ‘the information pertinent tocommodities or services appearing in each scene’ or the ‘number of timesof access events’ may be the route of reception thereof, simultaneouslywith the picture program data, route of reproduction thereof,simultaneously with the picture program data, route of reception of theprogram ancillary data by itself, route of reproduction of the programancillary data by itself, or the route of receiving the information frome.g., a database over a communication path. This display function may beexecuted not only on a display picture used for confirming the contentsof the program ancillary data but also on a basket picture or on adisplay picture for the detailed information of commodities or services.

The terminal used for executing the method may be a computer terminal(notebook or desktop computer), PDA, a portable telephone set, a gamemachine, a set top box, a PC card, a car navigation system, awrist-watch having the information processing function, and so forth, inaddition to a dedicated server device. The respective steps of the abovemethod do not have to be executed on the same device but may be executedon different devices. The same may be said for the methods that follow.

Meanwhile, the explanation on other terms common to the above-describedmeans is the same as that for these means.

As the twenty-second means, the present invention proposes a pictureinformation displaying method for displaying, on a display picture, theinformation pertinent to commodities or services appearing in each sceneof a picture program, responsive to a request from the viewer, in whichthe method includes a processing step of reading out the results ofsummation of the number of times of commodity-based or service-basedaccess events by the viewer to a database, which supervises the detailedinformation relevant to the commodities or services appearing in a sceneto be displayed, and a processing step of displaying the read-outresults in association with each information relevant to the commoditiesor services appearing in a scene in question.

With use of this program information displaying method, the viewer isable to judge readily whether or not the specified commodities orservices appearing in a picture program are in vogue among otherviewers, irrespective of the routes of acquisition of the information onthe number of times of access events.

Meanwhile, the route of acquisition of ‘the information pertinent tocommodities or services appearing in each scene’ or the ‘number of timesof access events’ may be the route of reception thereof simultaneouslywith the picture program data, route of reproduction thereofsimultaneously with the picture program data, route of reception of theprogram ancillary data by itself, route of reproduction of the programancillary data by itself, or the route of receiving the information frome.g., a database over a communication path. This display function may beexecuted not only on a display picture used for confirming the contentsof the program ancillary data but also on a basket picture or on adisplay picture adapted for demonstrating the detailed information ofcommodities or services.

Meanwhile, the explanation on other terms common to the above-describedmeans is the same as that for these means. Of course, the step ofdisplaying the number of times of access events on the commodity- orservice-basis in the twenty-second means may be combined with the stepof displaying the number of times of scene-based access events of thetwenty-first means.

As the twenty-third means, the present invention proposes a pictureinformation displaying method for displaying, on a display picture, theinformation pertinent to commodities or services appearing in each sceneof a picture program, responsive to a request from the viewer, in whichthe method includes a processing step of reading out an index picture ofa scene to be displayed, and a processing step of displaying the indexpicture, as read out, in conjunction with the information relevant tocommodities or services appearing in the scene in question.

With use of this program information displaying method, the viewer isable to judge readily which commodities or services appear in eachscene, irrespective of the routes of acquisition of the information onthe number of times of access events. In case of confirming theinformation pertinent to commodities or services, the contents can beconfirmed readily by displaying an index picture, given in general as astill picture.

Meanwhile, the route of acquisition of ‘the information pertinent tocommodities or services appearing in each scene’ or the ‘index picture’may be the route of acquisition of the information etc prepared in thedevice for executing the method, such as the route of reception thereofsimultaneously with the picture program data, route of reproductionthereof simultaneously with the picture program data, route of receptionof the program ancillary data by itself, route of reproduction of theprogram ancillary data by itself, or the route of having the informationfurnished from e.g., a database over a communication path. This displayfunction may be executed not only on a display picture used forconfirming the contents of the program ancillary data but also on abasket picture or on a display picture for the detailed information ofcommodities or services.

Meanwhile, the explanation on other terms common to the above-describedmeans is the same as that for these means. Of course, if the above meansis combined with the twenty-first or twenty-second means, such a displaypicture is obtained which is more convenient to use for the user.

As the twenty-fourth means, the present invention proposes a programinformation displaying method for displaying on a display picture theinformation relevant to commodities or services appearing in each sceneof a picture program, responsive to the viewer's request, in which themethod includes a processing step of reading out the informationrelevant to the commodities or services appearing in each scene, fordisplaying the information relevant to plural scenes in a list form, anda processing step of deploying the information, as read out, based onthe preset layout information, for presentation in a list form on adisplay picture.

With use of the program information displaying method, in which theinformation relevant to plural scenes can be confirmed at a time on thedisplay picture, it is unnecessary to perform the operation ofdisplaying the information of another scene on the display picture evenif the target information is not contained in the information pertinentto a given scene. This enables efficient retrieval as compared to thecase of individually accessing each picture. It should be noted that thelist form picture may be a picture downloaded from another terminaldevice, or prepared in a terminal which executes the display method.

For each scene displayed in a list form, the number of times ofscene-based access events or that of commodity- or service-based accessevents may be displayed. In this case, the above information may bedirectly downloaded from an external database.

Meanwhile, the explanation on other terms common to the above-describedmeans is the same as that for these means.

As the twenty-fifth means, the present invention proposes thetwenty-fourth means where an index picture is displayed in each of theplural scenes in association therewith.

With use of this program information displaying method, the target scenemay be selected as the contents of each scene are confirmed with anindex picture, thereby improving the operating efficiency. When theinformation pertinent to commodities or services is to be confirmed, itscontents can be visually recognized on an index picture.

Meanwhile, the explanation on other terms common to the above-describedmeans is the same as that for these means.

As the twenty-sixth means, the present invention proposes acomputer-readable recording medium having a program recorded thereon,the program being usable for a computer to implement a program ancillarydata extraction function of extracting from picture program data programancillary data relevant to commodities or services appearing in eachscene, and a display control function of displaying, on a displaypicture, the information relevant to the commodities or servicesappearing in each scene, and the sum total of the number of times ofscene-based access events by the viewer to a database supervising thedetailed information relevant to the commodities or services, based onthe preset layout information.

With use of this recording medium, any suitable pre-existing terminalcan be used as a program ancillary data processing device, on simplyinstalling the program recorded on the recording medium on apre-existing terminal, even if there is no device dedicated to programancillary data.

The ‘pre-existing terminal’ may be a computer terminal (notebook ordesktop computer), a portable information terminal (PDA), a portabletelephone set, a game machine, a car navigation system, a wrist-watchhaving the information processing function, and so forth. The recordingmedium may be a CD-ROM, a medium of the magnetic recording system, suchas magnetic tape, floppy disc, hard disc or magnetic card, an opticalrecording type medium, such as write-once CD, DVD or an optical card, amagneto-optical recording type medium, such as DVD, MD or MO, or asemiconductor memory, such as non-volatile memory or RAM. The same maybe said of terminals or recording mediums in respective means thatfollow.

Meanwhile, the explanation on other terms common to the above-describedmeans is the same as that for these means. Although the program isassumed to be distributed by a recording medium, it may also bedistributed over a network (transmission medium).

As the twenty-seventh means, the present invention proposes acomputer-readable recording medium having a program recorded thereon,the program being usable for a computer to implement a program ancillarydata extraction function of extracting, from picture program data,program ancillary data relevant to commodities or services appearing ineach scene, and a display control function of displaying, on a displaypicture, the information relevant to the commodities or servicesappearing in each scene, and the sum total of the number of times ofcommodity-based or service-based access events by the viewer to adatabase supervising the detailed information relevant to thecommodities or services, based on the preset layout information.

With use of this recording medium, any suitable pre-existing terminalcan be used as a program ancillary data processing device, on simplyinstalling the program recorded on the recording medium on the terminal,even if there is no device dedicated to program ancillary data.

Meanwhile, the explanation on other terms common to the above-describedmeans, such as ‘pre-existing terminal’ or ‘recording medium’ is the sameas that for these means.

As the twenty-eighth means, the present invention proposes acomputer-readable recording medium having a program recorded thereon,the program being usable for a computer to implement a program ancillarydata extraction function of extracting from picture program data programancillary data relevant to commodities or services appearing in eachscene, and a display control function of displaying, on a displaypicture, the information relevant to the commodities or servicesappearing in each scene, based on the layout information adapted forpresenting the information pertinent to plural scenes in a list form tothe viewer.

With use of this recording medium, any suitable pre-existing terminalcan be used as a program ancillary data processing device, on simplyinstalling the program recorded on the recording medium on the terminal,even if there is no device dedicated to program ancillary data.

Meanwhile, the explanation on other terms common to the above-describedmeans, such as ‘pre-existing terminal’ or ‘recording medium’ is the sameas that for these means.

As the twenty-ninth means, the present invention provides acomputer-readable recording medium having a program recorded thereon, inwhich the program is usable for a computer to implement an extraneousdata presence/absence detection function of extracting, from pictureprogram data, data indicating whether or not the information relevant tocommodities or services appearing in each scene is available through anexternal database, to detect the presence/absence of the extraneous databased on the so extracted data, a downloading function of downloading,when an access request to extraneous data is made by an operating inputby the viewer, a list file which is an information file provided fromthe outset for a relevant picture program for presenting the informationrelevant to plural scenes to the viewer in a list form, from an externaldatabase, and a display control function of opening the downloaded listfile to display the information relevant to the plural scenes involvedin the list file on a display picture in a list form, based on thepreset layout information.

With use of this recording medium, any suitable pre-existing terminalcan be used as a program ancillary data processing device, on simplyinstalling the program recorded on the recording medium on the terminal,even if there is no device dedicated to program ancillary data.

Meanwhile, the explanation on other terms common to the above-describedmeans, such as ‘pre-existing terminal’ or ‘recording medium’ is the sameas that for these means.

As the thirtieth means, the present invention proposes acomputer-readable recording medium having a program recorded thereon,the program being usable for a computer to implement a downloadingfunction of downloading the information relevant to commodities orservices appearing in each scene from a recording medium supervised byanother terminal device, by communication with another terminal device,and a display control function of demonstrating the information relevantto commodities or services appearing in each scene, on a displaypicture, responsive to an operating input by an operator. Theinformation relevant to commodities or services is program ancillarydata of a picture program in question.

With use of this recording medium, any suitable pre-existing terminalcan be used as a program ancillary data processing device, on simplyinstalling the program recorded on the recording medium installed on theterminal, even if there is no device dedicated to program ancillarydata.

Meanwhile, the explanation on other terms common to the above-describedmeans, such as ‘pre-existing terminal’ or ‘recording medium’ is the sameas that for these means.

As the thirty-first means, the present invention proposes acomputer-readable recording medium having recorded thereon a programusable for a computer to implement a display control function ofdisplaying an index picture of a scene, in an imaged object of which areincluded commodities or services selected with a will for purchasing, ina correlated fashion in a basket picture in which the will forpurchasing can be confirmed prior to final transmission to the serverside.

With use of this recording medium, any suitable pre-existing terminalcan be used as a program ancillary data processing device, on simplyinstalling the program, recorded on the recording medium, on theterminal, even if there is no device dedicated to program ancillarydata.

Meanwhile, the explanation on other terms common to the above-describedmeans, such as ‘pre-existing terminal’ or ‘recording medium’ is the sameas that for these means.

As the thirty-second means, the present invention proposes acomputer-readable recording medium having recorded thereon a programusable for a computer to implement an access information acquiringfunction of acquiring, responsive to a request from the viewer connectedto the computer over a communication network, the information pertinentto access states from the viewer to a database supervising the detailedinformation pertinent to commodities or services appearing as an imagedobject in a picture program, and a communication function for notifyingthe latest value of the number of times of scene-based access events asacquired by the access information acquiring function and as requestedby the viewer.

With use of this recording medium, any suitable pre-existing terminalcan be used as a program ancillary data processing device, on simplyhaving the program recorded on the recording medium installed on theterminal, even if there is no device dedicated to program ancillarydata.

Meanwhile, the explanation on other terms common to the above-describedmeans, such as ‘pre-existing terminal’ or ‘recording medium’ is the sameas that for these means.

As the thirty-third means, the present invention proposes acomputer-readable recording medium having recorded thereon a programusable for a computer to implement an access information acquiringfunction of acquiring, responsive to a request from the viewer connectedto the computer over a communication network, the information pertinentto access states from the viewer to a database supervising the detailedinformation pertinent to commodities or services appearing as an imagedobject in a picture program, and a communication function for notifyingthe latest value of the number of times of community-based orservice-based access events as acquired by the access informationacquiring function and as requested by the viewer.

With use of this recording medium, any suitable pre-existing terminalcan be used as a program ancillary data processing device, on simplyhaving the program recorded on the recording medium installed on theterminal, even if there is no device dedicated to program ancillarydata.

Meanwhile, the explanation on other terms common to the above-describedmeans, such as ‘pre-existing terminal’ or ‘recording medium’ is the sameas that for these means.

As the thirty-fourth means, the present invention proposes acomputer-readable recording medium having recorded thereon a programusable for a computer to implement an information furnishing function ofaccessing a database supervising the detailed information pertinent tocommodities or services appearing as an imaged object in a pictureprogram, responsive to a request from the viewer connected to thecomputer over a communication network, for presenting a list fileprovided from the outset for presenting the information relevant toplural scenes to the viewer in a list form. The list file is aninformation file provided from the outset for a relevant pictureprogram.

With use of this recording medium, any suitable pre-existing terminalcan be used as a program ancillary data processing device, on simplyhaving the program recorded on the recording medium installed on theterminal, even if there is no device dedicated to program ancillarydata.

Meanwhile, the explanation on other terms common to the above-describedmeans, such as ‘pre-existing terminal’ or ‘recording medium’ is the sameas that for these means.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a conceptual structure of an entire digital broadcastsystem.

FIG. 2 shows a conceptual structure of a digital broadcast system in theperspective of circulation of data ancillary to a program.

FIG. 3 shows an illustrative structure of a digital broadcasting system.

FIG. 4 is a functional block diagram showing an embodiment of asponsorship request condition inputting device (first embodiment).

FIG. 5 is a functional block diagram showing an embodiment of asponsorship request condition inputting device (second embodiment).

FIG. 6 shows an embodiment of a display picture for a sponsorshiprequest condition inputting form.

FIG. 7 shows an illustrative structure of sponsorship request conditiondata.

FIG. 8 is a flowchart showing an embodiment of a processing sequence ininputting the sponsorship request condition.

FIG. 9 is a functional block diagram showing an embodiment of a responseresult receiving device.

FIG. 10 shows an embodiment of a display picture of a form of responseresult confirmation.

FIG. 11 shows an illustrative structure of response result data.

FIG. 12 is a functional block diagram showing an embodiment of asponsorship transaction brokerage server.

FIG. 13 shows an illustrative structure of data of a membershipdatabase.

FIG. 14 is a flowchart showing a typical processing sequence on receiptof a sponsorship request.

FIG. 15 is a functional block diagram showing an embodiment of asponsorship request receiving device.

FIG. 16 shows an embodiment of a display picture of a form ofconfirmation of request content.

FIG. 17 is a functional block diagram showing an embodiment of anadvance registration information inputting device.

FIG. 18 shows an embodiment of a display picture of a generic itemregistration form.

FIG. 19 shows an embodiment of a display picture of a sponsorshipcondition registration form.

FIG. 20 shows an illustrative structure of ancillary information data.

FIG. 21 shows a specified embodiment of commodity and service data inagreement with the content of a video program.

FIG. 22 is a functional block diagram showing an embodiment of a devicefor the preparation of data ancillary to a program (first embodiment).

FIG. 23 is a functional block diagram showing an embodiment of a devicefor the preparation of data ancillary to a program (second embodiment).

FIG. 24 is a functional block diagram showing an embodiment of a devicefor the preparation of data ancillary to a program (third embodiment)

FIG. 25 shows an embodiment of a display picture of a form for inputtingdata ancillary to a program (first embodiment).

FIG. 26 shows an embodiment of a display picture of a form for inputtingdata ancillary to a program (second embodiment).

FIG. 27 shows an embodiment of a display picture of a form for inputtingdata ancillary to a program (third embodiment).

FIG. 28 is a flowchart showing an embodiment of a processing sequence ininputting data ancillary to a program (first embodiment).

FIG. 29 is a flowchart showing an embodiment of a processing sequence ininputting data ancillary to a program (second embodiment).

FIG. 30 is a functional block diagram showing an embodiment of a devicefor the preparation of data ancillary to a program.

FIG. 31 is a functional block diagram showing an embodiment of a devicefor the preparation of picture program data.

FIG. 32 is a functional block diagram showing an embodiment of a videoprogram editing device.

FIG. 33 shows an embodiment of a display image in preparing or editingdata ancillary to a program (first embodiment).

FIG. 34 shows an embodiment of a display image in preparing or editingdata ancillary to a program (second embodiment).

FIG. 35 shows an embodiment of a display image in preparing or editingdata ancillary to a program (third embodiment).

FIG. 36 shows an embodiment of a display image in preparing or editingdata ancillary to a program (fourth embodiment).

FIG. 37 shows an embodiment of a display image in preparing or editingdata ancillary to a program (fifth embodiment).

FIG. 38 is a flowchart showing an embodiment of a processing sequence inpreparing data ancillary to a program (first embodiment).

FIG. 39 is a flowchart showing an embodiment of a processing sequence inpreparing data ancillary to a program (second embodiment).

FIG. 40 is a functional block diagram showing an embodiment of a devicefor processing data ancillary to a program (first embodiment).

FIG. 41 is a functional block diagram showing an embodiment of a devicefor processing data ancillary to a program (second embodiment).

FIG. 42 is a functional block diagram showing an embodiment of a devicefor processing data ancillary to a program (third embodiment).

FIG. 43 is a functional block diagram showing an embodiment of a devicefor processing data ancillary to a program (fourth embodiment).

FIG. 44 is a functional block diagram showing an embodiment of a devicefor processing data ancillary to a program (fifth embodiment).

FIG. 45 shows an embodiment of a display picture of a video programprovided with data ancillary to a program (first embodiment).

FIG. 46 shows another embodiment of a display picture of a video programprovided with data ancillary to a program (second embodiment).

FIG. 47 shows an embodiment of a display picture of a meta-pocketpicture (first embodiment).

FIG. 48 shows an embodiment of a display picture of a meta-pocketpicture (second embodiment).

FIG. 49 shows an embodiment of a display picture of a meta-pocketpicture (third embodiment).

FIG. 50 shows an embodiment of a display picture of a meta-pocketpicture (fourth embodiment).

FIG. 51 shows an embodiment of a display picture of a meta-mall picture(first embodiment).

FIG. 52 shows an embodiment of a display picture of a meta-mall picture(second embodiment).

FIG. 53 shows an embodiment of a display picture of a meta-cart picture.

FIG. 54 shows an embodiment of a commodity information site picture.

FIG. 55 shows an embodiment of another display picture (firstembodiment).

FIG. 56 shows an embodiment of still another display picture (secondembodiment).

FIG. 57 is a flowchart showing an example of a processing sequence indisplaying data ancillary to a program.

FIG. 58 is a functional block diagram showing an embodiment of a serverdevice (first embodiment).

FIG. 59 is a functional block diagram showing an embodiment of a serverdevice (second embodiment).

FIG. 60 is a flowchart showing an example of a processing sequence indisplaying a meta-pocket.

FIG. 61 is a flowchart showing an example of a processing sequence indisplaying a meta-mall.

BEST MODE FOR CARRYING OUT THE INVENTION

Referring to the drawings, certain present embodiments of the presentinvention will be explained in detail.

(A) Overall System Envisioned in the Present Specification

(A-1) Example of Conceptual Structure

First, an example of a conceptual structure of the entire system, asenvisioned in the present specification, is explained. The entire systemincludes, as a basic structure, a stage of sponsorship tie up to aproject (stage of receiving the accepting a project), a stage ofemploying goods or services furnished to execute the project, includingcreation and distribution, and a stage of coupling the results ofexecution to on-line shopping.

In the ensuing explanation, it is assumed that the ‘project’ is thecreation of a digital broadcast program. FIG. 1 shows an illustrativeconceptual structure of the digital broadcast system. Of course, FIG. 1shows an illustration, such that variegated forms may be conceived forthe digital broadcasting system.

The digital broadcasting system, shown in FIG. 1, is roughly made up ofthree partial systems. One of these systems is a sponsorship transactionsupport system for on-line realization of a transaction pertinent to asponsorship request of goods and services to a digital broadcastprogram. Another of the systems is a subsidiary information datacreating system for preparing program ancillary data, which correlatesthe information pertinent to the commodities and services offered by thesponsor business operators to each scene of the picture program, whilethe remaining one is the program ancillary data processing system forreceiving or reproducing the program ancillary data correlated to eachscene to realize on-line shopping.

In the case of FIG. 1, the sponsorship transaction support system ismade up by a sponsor business operator 1, a broadcast business operator2 and by a sponsorship transaction brokerage business operator 4. Thesubsidiary information data creating system is made up by the broadcastbusiness operator 2 and by a shopping brokerage business operator 5. Theprogram ancillary data processing system is made up by the audience 3,the shopping brokerage business operator 5 and by the sponsor businessoperator 1.

It should be noted that the presence of brokerage business operators ineach partial system is not mandatory, that is, if there is nointerposing brokerage business operator, the functions necessary for atransaction are executed by one or more of the sponsor business operator1, broadcast business operator 2 and the audience 3.

Although the sponsorship transaction brokerage business operator 4 andthe shopping brokerage business operator 5 are routinely managed bydifferent undertakers, there may, of course, be managed by the sameundertaker.

(a) Sponsorship Transaction Support System

In the case of the sponsorship transaction support system, shown in FIG.1, an entity making a request for sponsorship for creation of a videoprogram is the broadcast business operator 2, while the undertaker readyto accept the request is the sponsor business operator 1. It is thesponsorship transaction brokerage business operator 4 that acts asintermediary for the sponsorship transaction.

The sponsorship transaction routinely is executed as follows: Abroadcast business operator first issues a request for sponsorship tothe brokerage business operator. Of course, this request for sponsorshipis made on-line. The brokerage business operator forwards a request forsponsorship, accepted from the broadcast business operator, to sponsorbusiness operators registered in a database (registered members).

Variegated methods may be thought of as the forwarding method. Examplesof these methods include sending the request unconditionally to allregistered members, and sending the request selectively based on thecontent of the request for sponsorship. The latter method may beclassified into a method of taking into account the conditions as set bythe broadcast business operator, as a client, a method of taking intoaccount the conditions as set by the broker acting as intermediary forsponsorship request, a method of taking into account the conditions asset by the sponsor business operator, as a request receiving party, anda method comprised of optional combinations of these respective methods.

This forwarding is accompanied by a metadata frame (right for makinginsertions in the data ancillary to the program). That is, theforwarding is accompanied by the right to get the information pertinentto furnished goods or services included in metadata (data ancillary tothe program) which is the ancillary information to program data(generally video and acoustic data and occasionally the video data oracoustic data) if the member who has received the request agrees to thesponsorship.

The sponsor business operator, who has received and is willing to agreeto the request, notifies the brokerage business operator of such effect.The brokerage business operator checks whether or not the content of theagreement conforms to items of request. When the content of theagreement conforms to the items of request, for example, when therequest destination is only one business operator and only one businessoperator has agreed to the sponsor, or when the quantity of the goods tobe furnished is in meeting with the quantity as stated in the request,the brokerage business operator notifies the broadcast business operatorof the content of the finalized transaction.

When the content of the acceptance is not quantitatively up to the itemsof sponsorship, for example, when the number of the business operatorswho agreed to the sponsorship exceed a scheduled number or when thenumber of goods that can be furnished by the agreeing plural businessoperators exceeds a scheduled number, the brokerage business operatorspecifies the quantity for the benefit of the broadcast businessoperator, or adjusts the number of goods furnished by the agreeingbusiness operators, and notifies the broadcast business operator of thecontent of the finally determined transaction. If necessary, theexchange of communication may take place several times between thebrokerage business operator and the sponsor business operator(s).

Meanwhile, if the agreed content is not quantitatively up to the itemsof sponsorship, for example, if the conditions in the agreed content arenot up to the desired conditions geographically or temporally, thebrokerage business operator notifies the sponsor business operator ofthe effect of failure in the conclusion of the transaction. Meanwhile,if the sponsorship transaction is not concluded, the brokerage businessoperator notifies the broadcast business operator of the failure in theconclusion of the sponsorship transaction, from one subject-matter ofthe transaction to another, that is from one commodity or service toanother.

The foregoing is the general flow of the sponsorship transaction.Meanwhile, if an operator with high possibility of success in theconclusion of the sponsorship transaction has become apparent prior totransmission of the sponsorship request by the brokerage businessoperator, it may be contemplated to inform only the parties concerned ofthe existence of the competing counterparty. This may be realized bypre-registration on the database by no other than the operator willingto agree to the sponsorship of the conditions under which the operatormay agree to the sponsorship. In such case, the brokerage businessoperator proceeds to match the content of the sponsorship requestreceived from the client and the information of advance registration inthe database to finally decide on the parties of contract.

(b) Subsidiary Information Data Creating System

In the case of the subsidiary information data creating system, shown inFIG. 1, it is the broadcast business operator 2 who creates anddistributes a video program, while it is the shopping brokerage businessoperator 5 who creates program ancillary data to be associated withrespective scenes of the picture program. Meanwhile, it may be anoccurrence that the sponsorship transaction brokerage business operator4 acing as intermediary for sponsorship transactions becomes an entityin creating the program ancillary data, or the broadcast businessoperator 1 for itself becomes an entity in creating the programancillary data.

Meanwhile, the broadcast business operator may encompass a companyspecialized in creating an image program. Today, the broadcast businessoperator may even be consumers in consideration of the development inthe communication technology and cost reduction in variegated equipment.

The creation and distribution of picture programs at large may beachieved as follows: First, in creating, that is the imaging, storage orthe editing etc. of the picture program, the broadcast businessoperator, usually made up by a creating company and a distributingcompany, prepares and records program ancillary data (metadata) relevantto each scene of a picture program. The program ancillary data(metadata) here is termed key data at large or management data. Theseare data necessary for e.g., data management. The program ancillary datais also used for retrieving data from variegated stored information. Forexample, the metadata may be exemplified by the code information, suchas UMID (Unique Material Identifier), capable of uniquely identifyingthe image material on a global extent, such as on the station-wide,keiretu-wide, or nation-wide basis, scene numbers, performers,positions, sites, such as GPS information and by program names. It ishowever desirable to be able to use the code information that can beidentified uniquely on the global basis.

Moreover, data of commodities and services for the respective scenes arealso recorded. By and large, these information are not necessarilylimited to sponsor goods. However, since the data on the commodities andservices are also utilized in the present specification for on-lineshopping, it is necessary that only the data relevant to the sponsorship(subject-matter of sponsorship) are recorded or that distinction may bemade between the goods or services as the subject-matter of thesponsorship and those which are not the subject-matter of thesponsorship.

In the case of FIG. 1, only the minimum information recorded in thecourse of imaging, such as the names of the sponsor business operatorsor the generic names of commodities and services, for example,spectacles, retail, etc., are given the broadcast business operator whofinally creates the program ancillary data (metadata). Of course, thebroadcast business operator may create data up to precise details, or nodata concerning the commodities or services may be recorded, dependingon the type of the system under construction.

The brokerage business operator collects further detailed informationconcerning the commodities or services, notified by the broadcastbusiness operator, from the sponsor business operators, or from thedatabase, which may be supervised by the sponsorship transactionbrokerage business operator or by each sponsor business operator. Thebroadcast business operator then creates a picture to be furnished tothe audience, using the description language, that is BML (broadcastmarkup language) or XML (extensible markup language), including thelayout information (layout information in a picture), to send the socreated image information as program ancillary data to the broadcastbusiness operator.

Of course, there may be an occasion wherein such program ancillary datais sent to the broadcast business operator in which the layoutinformation (template image indicating the pasting position for the tagand the information providing for the method for representation) and theinformation concerning the commodities or services as collectedrepresent different data.

That is, the program ancillary data (metadata) may be classified intoone comprised of the layout information and the data of the commoditiesor services, unified together, that is data finished to such an extentthat the data can directly be viewed or heard on expansion in accordancewith the description language, and one in which the layout informationis distinct from the data on commodities or services, that is data inwhich, in data presentation to the user, the data on commodities orservices are pasted to the layout information.

Moreover, the brokerage business operator creates the index information,usable for representing the respective scenes associated with theprogram ancillary data in a simplified fashion, as necessary, and sendsthe so created index information to the broadcast business operator.

In any of these cases, the brokerage business operator adds the codeinformation, specifying the respective scenes, to the program ancillarydata. Based on this code information, the broadcast business operator isable to reliably correlate the images of the associated scenes with theprogram ancillary data.

On acquisition of the program ancillary data from the brokerage businessoperator, the broadcast business operator correlates the program dataand the program ancillary data with each other, based on the codeinformation, and transmits the resulting data as broadcast waves in anultimately output form. Although FIG. 1 shows the case of satellitebroadcast, the broadcast may be by ground waves or waves transmittedover a cable, such as power line, telephone line, optical cable etc. Theoutput form may, of course, be communication in place of broadcast. Thedata may also be recorded on a package medium for distribution as apackage medium.

(c) Digital Picture Program Receipt/Reproducing System

In the case of the digital picture program receiving/reproducing system,shown in FIG. 1, it is the audience 3 that receives or reproduces thepicture program, while it is the shopping brokerage business operator 5that accepts the offer of the detailed commodity information responsiveto the request from the audience, or accepts the order. On the otherhand, it is the sponsor business operator 5 that furnishes thecommodities or services based on the buy-sell agreement concluded withthe audience.

There may, of course, be a system devoid of an interposing shoppingbrokerage business operator. There may also be an occasion where noinformation concerning the commodities or services is received from thebrokerage business operator in case the information on the commoditiesor services given as program ancillary data (metadata) suffices.

The viewing of the picture programs at large and the on-line shoppingoccur as follows: If, in viewing the picture program, the audience comesacross goods or services he or she is interested in, he or she operatesfor demonstrating the program ancillary data, usually by acting on aremote controller. When there is any program ancillary data associatedwith the scene, the information is displayed on part or all of thedisplay picture.

Usually, a display image representing the information concerning thecommodities or services is represented. In the present specification,this information is referred to as meta-pockets or meta-mall. Themeta-pocket is used in the meaning of a display picture for theinformation concerning the commodities or services appearing in aparticular scene or the program ancillary data associated with theinformation, while the meta-mall is used in the meaning of a displaypicture which allows for overview of meta-pockets for plural scenes on asole picture or in the meaning of the program ancillary data associatedwith the information.

These display pictures may be demonstrated simultaneously with thedisplay of a picture program, as the main program, or independently ofthe picture program display, such as on termination of the broadcast orreproduction of the picture program.

As for the content of the display picture, solely the informationconcerning the sole commodities or services represented on the displaypicture may be displayed, or the totality of the information concerningthe plural commodities or services represented on the sole picture maybe displayed. Although it is assumed in FIG. 1 that the commodities orservices to be demonstrated are supplied by the sponsor businessoperator, the commodities or services supplied may also benon-sponsorship commodities or services (commodities or services whichare not the subject-matter of the sponsorship). The commodities orservices demonstrated may not be sponsorship commodities or services(commodities or services which are the subject-matter of thesponsorship) but may be the commodities or services of the programpurveyors.

The display content may also be variable, as may be seen from thespecified examples as later explained. It is assumed that the audiencehas requested the display of the information which is more detailed thanthe information currently displayed on the display picture. When therequest is input by a specified actuation by the audience, theinformation distribution is requested to a brokerage business operatorfrom a terminal fitted with a communication function and which forms aviewing system along with a display device, routinely a televisionreceiver or a set top box. The uplink transmission path, over which therequest is transmitted, may be exemplified by the telephone network,packet network or the Internet. The transmission medium may, of course,be cabled or wireless.

On receipt of the request from the audience, the brokerage businessoperator reads out the information as requested from the database totransmit the so read-out information. This information may include theinformation indicating the degree of interest on the part of theaudience, such as number of times of access events, in the scene inquestion, and the commodities or services appearing in the scene. It isamong the advantages of providing the brokerage business operator to beable to supply this sort of the information.

If subsequently the audience is desirous to purchase the commodity he orshe is interested in, he or she sends order data, as the expression ofsuch intention, over the uplink transmission path to complete thebuy-sell agreement with the sponsor business operator. Before finallytransmitting order data, the state of the order may be confirmed by abasket picture, as in the case of the currently operating Internetshopping. This basket picture, also termed a cart picture, enables thesubject-matter purchased to be re-confirmed before actually sending theintention of buying the goods to the sponsor business operator.

When the intention of the audience in buying a commodity is notified tothe sponsor business operator, shipment of the commodity and payment areperformed subsequently as in the routine commercial transactions. If theinformation on the picture program or the scene which acted as incentivefor acquiring the information on the commodity or in placing an order isincluded in the communication the audience has with the brokeragebusiness operator or with the sponsor business operator, in a manner notshown in FIG. 1, such included information may be used as a referencematerial at the time of scheming a new picture program or at the time ofaccepting the sponsorship.

(d) Flow of Program Ancillary Data

FIG. 2 shows an illustrative conceptual structure of the digitalbroadcast system as viewed from the flow of the program ancillary data.In FIG. 2, the digital broadcast system is roughly classified into fourpartial systems, namely a sponsorship transaction brokerage system 6, acreation broadcast system 7, a reception reproduction system 8 and ashopping brokerage system 9, with the types of handling of the programancillary data as ad-hoc reference or index. In FIG. 2, the sponsorbusiness operator belongs mainly to the sponsorship transactionbrokerage system and the audience belongs to the reception reproductionsystem.

The feedback information (access information, agreement conclusioninformation or management data), as collected from the audience whoviewed a picture program, is sent from the shopping brokerage system 9to the sponsorship transaction brokerage system 6. As the accessinformation, there may, for example, be the information as to from whichscene of which picture program and for which commodities or services theaccess was made, or the information as to the sex or the age group ofthe audience. The information as to the conclusion of agreements may bethe number of concluded buy-sell agreements or the content of theagreements. The management data may be the program names, broadcast dateand time and program frames.

In the sponsorship transaction brokerage system 6, the above informationis used as the reference materials for scheming new picture programs orfor future sponsorship in order to execute a sponsorship transaction fora new picture program. The information finally determined in thistransaction, for example, the names of the establishments asparticipants in the sponsorship or the information on the commodities orservices as the subject-matter of the sponsorship, is sent to thecreation broadcast system 7.

The creation and broadcasting system 7 supervises the variegated dataproduced in the course of creation of picture programs, such as schemingdata, imaging data, storage data, editing data and distribution data,correlated with the information supplied from the sponsorshiptransaction brokerage system 6 or from the shopping brokerage system.

The scheming data may be enumerated by, for example, the tenor ofprogram creation, target, scheming staff members etc. The imaging datamay be enumerated by, for example, the date and time, site or weather atthe time of imaging, staff members, sponsor goods or services used ineach scene, and imaging equipment. The storage data may, for example, bethe identification number and address of a recording medium. The editingdata may, for example, be the editing scene, special effects used,editing staff members etc. The distribution data may, for example, bethe date and time of distribution, territory, copyright information,information on the distributor and the information on the right to use.

From the shopping brokerage system 9, the information on the number oftimes of access events, the information on the concluded agreements andthe information on the commodities or services are supplied. When theshopping brokerage business operator is responsible for supplying theprogram ancillary data (metadata), as in the system shown in FIG. 1, theso prepared program ancillary data is also supplied.

These information are correlated with one another through theinformation specifying the respective scenes of the respective programs,such as UMID. So, the readout or editing may take place freelyindependently of the storage sites of the variegated information.Meanwhile, the information selected depending on the application isultimately distributed from the creation broadcast system 7 to thereception reproduction system 8.

The reception reproduction system 8 acquires at least the generic keydata and management data, as program ancillary data supplied from thecreation and broadcasting system 7. The data on the commodities orservices may be distributed along with the program data from thecreation and broadcasting system 7 or from the shopping brokerage system9 as necessary.

On the other hand, the reception reproduction system 8 exploits theindex picture or the number of times of access events, as necessary, todisplay the data pertinent to commodities or services on the displaypicture. The index image may be generated internally or obtained fromthe creation and broadcasting system or the reception reproductionsystem, whilst the number of times of access events may be obtained fromthe creation and broadcasting system 7 or from the shopping brokeragesystem.

Meanwhile, the layout information for generating the display picture forthe information concerning the commodities or services is routinelyfurnished from the creation and broadcasting system or the shoppingbrokerage system. It is of course possible to provide these informationin an audience side terminal.

When the audience requests the detailed information as to thecommodities or services, the reception reproduction system 8 sends thepersonal information, access information or the management data etc. tothe shopping brokerage system 9. Similarly, when offering to buy thecommodities or services appearing on a scene of the picture program, thereception reproduction system 8 sends the buying offering information,personal information, such as name, address, mail number, sex, age etc.,access information, for example, the information on the address whichholds the information and management data etc. to the shopping brokeragesystem 9.

This accumulates the program ancillary data relevant to the furnishmentof the information or the purchase of the commodities or services inassociation with the data ancillary to the picture program in theshopping brokerage system 9. These information prove beneficialinformation in carrying out commercial transactions by the shoppingbrokerage system 9, while also proving beneficial reference informationfor the next ensuing sponsorship transactions which may be executed onthe sponsorship transaction brokerage system 6 as described above.

(A-2) Illustrative Structure

FIG. 3 shows an illustrative structure of the digital broadcast system.FIG. 3 shows an illustrative structure in case all terminals making upthe system are interconnected over a network 10. Meanwhile, FIG. 3 showsan example in which the sponsorship transaction brokerage businessoperator and the shopping brokerage business operator are the same or inwhich different undertakers or operators form a virtual LAN (Local AreaNetwork).

In this case, the brokerage business operator, broadcast businessoperator, sponsor business operator and the audience are interconnectedover the broadband WAN (Wide Area network). The connection of the LANwith the broadband WAN uses a WWW (World Wide Web) server 11 operatingas a gateway. The broadcast business operator, sponsor business operatorand the audience use their respective dedicated WWW servers 11.

The structure of LAN, supervised and managed by the brokerage businessoperator, is now explained. This LAN is made up by a system controller12, controlling the variegated systems installed on the network 10, asponsorship transaction brokerage processing management system 13, ashopping brokerage processing management system 14, anassessment/settlement processing system 15 and a customer managementsystem 16.

The sponsorship transaction brokerage processing management system 13 ismade up of a supervising section 13A, a retrieval processing computer13B, a sponsor operator database 13C, and a WWW site creation computer13D, as main components. In actuality, the supervising section 13A ofthe sponsorship transaction brokerage processing management system ismade up by a computer. Meanwhile, the computer is made up by a CPU, astorage unit (RAM, ROM etc), a peripheral device(s) and an input/outputdevice, interconnected over a bus. The functions executed by therespective computers are routinely implemented as an application program(software).

The retrieval processing computer 13B retrieves the sponsor operatordatabase 13C to retrieve the sponsor operators who are in meeting withthe sponsorship request from the broadcast business operator (the partywho requests the sponsor) or to decide on the destination ofdistributing the sponsorship request. The WWW site creation computer 13Dis used to prepare a display picture for the broadcast business operatoras the party who requests the sponsorship to input a sponsorship requestor to confirm the results of response to the sponsorship request. In thesponsor operator database 13C are stored the generic items necessary indeciding on the destination of distribution of the sponsorship requestand the conditions under which the sponsorship request may be accepted,as registration items.

The shopping brokerage processing management system 14 has, as its maincomponents, a supervising section 14A, a meta-pocket forming computer14B, a meta-mall forming computer 14C and a metadata database 14D. Thesupervising section 14A of the shopping brokerage processing managementsystem is also made up by a computer. The computer structure is asdescribed above. The functions executed on the respective computers arealso as described above.

The meta-pocket forming computer 14B is used for generating themeta-pocket (display for the information pertinent to the commodities orservices appearing in specific scenes or program ancillary dataassociated with the information). The meta-pocket generated may beaccorded to the broadcasting station or suitably distributed incompliance with the audience' requests. The scene information or thecommodity information necessary for meta-pocket generation are routinelyacquired from the broadcast business operator or from the sponsorbusiness operator. Alternatively, it may be acquired from the sponsoroperator database 13C.

The meta-mall forming computer 14C is used for generating the meta-malls(display image which allows for overview on one display picture of themeta-pockets concerning plural scenes, or the program ancillary dataassociated with the information). The so generated meta-mall may beaccorded to the broadcasting station or suitably distributed incompliance with the audience' requests. The scene information or thecommodity information similarly necessary for meta-pocket generation areroutinely acquired from the broadcast business operator or from thesponsor business operator. Alternatively, it may be acquired from thesponsor operator database 13C.

The metadata database 14D is used for storing the generated meta-pocketsor meta-malls.

The assessment/settlement processing system 15 is a computer system forexecuting the assessment or settlement processing pertinent to theutilization of the on-line shopping or service exploitation, such asinformation browsing or downloading chargeable data. The customermanagement system 16 is used for storing the information of the customer(audience) handled by the assessment/settlement processing system 15 andfor retrieving the information as necessary.

With the above-described structure of the system for the brokeragebusiness operators, it is possible to realize a digital broadcast systemwhich makes it possible to cross-link the scheming stage of the videoprogram (acquisition of sponsor operators) and the stage of utilizationby the audience of the program ancillary data (metadata).

The foregoing is the explanation of the conceptual structure and anillustrative structure in case of application of the overall system asenvisioned in the present specification to the digital broadcast system.The specified illustrative structure of respective partial systemsmaking up the overall system, as envisioned in the presentspecification, is now explained in detail.

(B) Sponsorship Transaction Support System

As typical of the sponsorship transaction support system for on-linerealization of the sponsorship transaction between a party making arequest for sponsorship to a project and registered members, there are asystem constructed by two parties, namely a party making the request andthe sponsor business operator, and a system constructed by threeparties, namely a party making the request, a brokerage businessoperator and the sponsor business operator.

The former system is realized mainly by exchange via E-mail and exchangethrough a WWW (World Wide Web) picture supervised by the party makingthe request. The latter system is realized mainly by exchange with theE-mail interposed by the brokerage business operator and exchangethrough a WWW (World Wide Web) picture supervised by the brokeragebusiness operator.

Meanwhile, the number of the brokerage business operator need not besingular such that an undertaker or operator operating as a wicket oftransaction may be distinct from an undertaker or operator responsiblefor maintenance and supervision of the transaction information. It issufficient in such case if functional elements making up the brokerageserver as later explained are provided in a distributed fashion in theterminals of different undertakers or operators.

(B-1) Terminal on the Party Making a Request for Sponsorship

In case of constructing a sponsorship transaction support system, theterminal of the party making a request for sponsorship needs to beprovided with a function of creating the sponsorship request andtransmitting the so created sponsorship request to the sponsor businessoperator and a function of receiving a response from the sponsorbusiness operator to check for its content. In actuality, thesefunctions are mostly realized on one terminal. However, the respectivefunction are explained severally for clarifying the technologicalelements required for executing the respective functions.

(a) Input Device for Sponsorship Request Conditions

(a-1) Terminal Structure

FIGS. 4 and 5 show an embodiment of a sponsorship request conditioninputting device having the function of inputting the sponsorshiprequest conditions. FIG. 4 shows the case where the sponsorshiptransaction support system is made up of three parties, namely the partymaking a request for sponsorship, the brokerage business operator andthe registered members. On the other hand, FIG. 5 shows the case wherethe sponsorship transaction support system is made up of two parties,that is the party making a request for sponsorship and the registeredmembers.

Reference is first made to FIG. 4 showing a device for inputting thesponsorship request conditions 20 made up by a display controller 20A,an input form recording unit 20B, an input data recording unit 20C, adistribution destination specifying unit 20D, a specifying rulerecording unit 20E, a controller 20F, a communication unit 20G, anoperating input unit 20H, a bus 20I and display means 20J.

In FIG. 4, the operating input unit 20H and the display means 20J aremounted outside of the main body unit of the device 20. Alternatively,the operating input unit and the display unit may be provided as onewith the main body unit of the device, as in the case of the notebookpersonal computer, PDA or the portable telephone set. Although therecording unit and the communication unit are shown enclosed in the mainbody unit of the device, these may be mounted outside the main bodyunit. The structure of each functional unit is hereinafter explained.

The display controller 20A reproduces picture data, received orreproduced, in a signal or data form suited to the display means 20J.The output signal may, for example, be a video output (NTSC video,composite video or S-video) or an RGB output. The display controller 20Aalso has the data decoding function, such as MPEG (Moving PictureExperts Group), depending on the particular purposes of use.

The input form recording unit 20B is a recording or storage medium forrecording an input form for sponsorship transaction. Of course, therecording medium is not to be used exclusively for storage of an inputform but may also be used for recording or storage of other sorts of theinformation. These mediums may be exemplified by, for example, a CD-ROM,mediums of the magnetic recording system, such as tape, floppy disc,hard disc or magnetic card, an optical recording type medium, such aswrite-once CD, DVD or optical card, magneto-optical recording typemedium, such as DVD, MD or MO, and semiconductor memory, such asnon-volatile memory or RAM.

The input form for recording will be explained in detail subsequently.The input form may be pre-fixed on the medium or duplicated from otherrecording mediums. Alternatively, the input form may be downloadedthrough communication networks, such as Internet. The input form isexpanded on a video RAM provided in the display controller 20A.

The input data recording unit 20C is a recording medium or a storagemedium for recording the data input through the operating input unit 20Hfor communication purposes.

The input form recording unit 20B and the input data recording unit 20Cmay be provided within the inside of the display controller 20A. Theinput form recording unit 20B, input data recording unit 20C and thespecifying rule recording unit 20E may also be mounted outside thecasing of the device for inputting the sponsorship request conditions20, without being mounted within the casing.

The distribution destination specifying unit 20D and the specifying rulerecording unit 20E are not provided for notifying all of the membersregistered in the membership database of the sponsorship requestunconditionally, but are provided for executing the processing ofnotifying only the registered members having to do in some way ordirectly with the sponsorship request in question. There may, however,be occasions where the notification be ultimately made to all members.

Although the specified functions are provided in FIG. 4 on the terminalsof the sponsorship requesting party, they may also be provided at theterminals of the brokerage business operator (brokerage server). It isalso possible to provide only one of the functions in the terminal ofthe sponsorship requesting party and to provide the other function inthe terminal (brokerage server) of the brokerage business operator. Insum, the above-mentioned functions may be provided in any side terminalif the distribution destination specifying unit 20D is able to read outthe specifying rule recorded in the specifying rule recording unit 20Eto decide on the destination of distribution.

In the device for inputting the sponsorship request conditions 20 havingthe above-mentioned structure, it may be presumed that the distributionof the sponsorship request to the specified registered member isroutinely performed by the device for inputting the sponsorship requestconditions itself. Alternatively, data stating the destination ofdistributon may be attached to the sponsorship request and transmittedto the brokerage business operator or to the communication businessoperator to cause the brokerage business operator or the communicationbusiness operator to send the data in multi-destination delivery.

The distribution destination specifying unit 20D is the informationprocessing means for implementing the function of specifying theregistered member(s) having to do in some way or directly with thesponsorship request based on the specifying rule stated in thespecifying rule recording unit 20E, as mentioned previously. On readingout the input data from the input data recording unit 20C, thedistribution destination specifying unit 20D executes the membershipinformation having to do specifically with the input data. The retrievalprocessing may be executed by the distribution destination specifyingunit 20D directly controlling a membership database 21. Alternatively,the distribution destination specifying unit 20D may input only thenecessary information to the membership database 21 to receive only theretrieved results obtained in the membership database 21.

Although FIG. 4 shows that the membership database 21 contains desiredconditions for distribution 21A, previously registered by the registeredmembers, it is probable that the membership database 21 lacks in suchdesired conditions for distribution 21A. Meanwhile, if there exist thedesired conditions for distribution 21A, the decision as to the area ofthe distribution is seasoned with the desire of the registered membersto whom the sponsorship request is distributed. The membership database21 is premised on the presence of the brokerage business operatorperforming the management.

By deciding on the area of distribution, based on such specific rules,it is possible to save the labor of the party making the sponsorshiprequest in specifying and inputting the counterparties and inputting theso specified counterparties. The operating efficiency may be improvedbecause a suitable area becomes the destination of distribution of thesponsorship on simply filling in the input form. Of course, thedistribution to all members may be made positively by stating thetotality of the registered members as the destination of distribution inthe input item. Conversely, only specified group(s) may be stated in theinput item as the area of distribution.

Since the decision of the area of distribution which is based on thespecified rule depends on the content of registration of the membershipdatabase, the sponsorship request may be issued to registered memberswho have not had the opportunities for transactions. This has the effectof enlarging the business chances.

The specifying rule may encompass logical sum conditions, logicalproduct conditions and other complex logical conditions for part or allof the input items. Meanwhile, the specific rules may take into accountthe tendency of past distribution or past agreements, more specifically,data as to whether or not the agreements reached conclusion or thenumber of the concluded agreements. The number of access events from theconsumers to the commodities or services furnished as the result of thesponsorship event and the number of the concluded agreements may also betaken into account. If these numbers being more than a preset value aretaken into the conditions of the logical expressions, it becomespossible to select those which met highly favorble results in the pastsponsorship events.

The specifying rule recording unit 20E is a recording medium forrecording a specifying rule. The recording medium may be a variety ofrewritable recording mediums, in addition to the read-only memories,such as CD-ROM. As aforesaid, the specifying rule recording unit 20E maybe provided at the terminal of the sponsorship requesting party, or onthe terminal of the brokerage business operator.

The specifying rule recorded on the specifying rule recording unit 20Emay be formed or edited on the side sponsorship requesting party. Insuch case, the intention of the sponsorship requesting party may bereflected in the area of distribution of the sponsorship requests.Meanwhile, if the specifying rule is registered, the area of thedistribution may be the same range at all times. Depending on thecontent of the sponsorship request, the sponsorship requests may, ofcourse, be distributed to a more desirable area by forming or editingthe specifying rule in agreement with such content.

The specifying rule recorded on the specifying rule recording unit 20Emay also be formed or edited on the side brokerage business operator. Insuch case, the intention of the brokerage business operator may bereflected in the area of distribution of the sponsorship request. Sincein general the information on the state of response to the pastdistribution area and on the tendency to agreement conclusion is storedat the brokerage business operator, it may be expected to optimize thearea of distribution. Depending on the content of the sponsorshiprequest, the sponsorship requests may again be distributed to a moredesirable area by forming or editing the specifying rule in agreementwith such content.

In any of the above cases, plural sorts of the specific rules, havingdifferent logical conditions or reference items may be provided so thatthe specific rules to be applied may be switched based on the content ofthe sponsorship requests, such as sorts of the projects for sponsorshipor the targeted customer layers.

Of course, the specific rules may include not only those initially setby undertakers manufacturing or selling sponsorship request conditioninputting device but also those initially set by a software creatingcompany furnishing an application program which permits a computer toexecute specified conditions as set for the destination of distribution.

In distinction from the case of unconditionally distributing thesponsorship request to all registered members, without regard to thespecific rules used, the area of distribution can be narrowed, in amanner favorable to the sponsorship requesting party, to the businessoperator ready to consent to the sponsor, and to the business operatorwhich manages the network. For example, the area of distribution may belimited to such scope of distribution from which sponsorship may beexpected, in a manner favorable for the party who has made thesponsorship request and who is not desirous to distribute thesponsorship request to counterparties irrelevant to the content of thesponsorship request. That is, the party who has made the sponsorshiprequest and who is not desirous to distribute the sponsorship request tocounterparties irrelevant to the content of the sponsorship request isable to limit the area of distribution to such a scope for which thesponsorship may be promising. The registered members unwilling toconsent to the sponsorship are also able with advantage to evade thereceipt of a large number of the sponsorship requests the consent towhich is against the intention of the registered members. The undertakerresponsible for network management may also be exempted from the risk ofthe data flow through the network increasing to more than a necessaryextent thus evading the excessive equipment cost.

The controller 20F controls various components making up the device forinputting the sponsorship request conditions 20, while executing signalprocessing operations. In general, the controller is in a micro-computerconfiguration. Usually, the functions of the controller 20F are governedby the operation system program and by the application program.

The communication unit 20G is means for communication with outside overa network. For the communication unit 20G, a communication equipmentconforming to the network is used. The network may be wired or wireless.For example, the network may be a telephone network, an IP network, adedicated line system, or an ATM network. The communication system maybe of the line connection type or of the packet connection type. Thenetwork may be of an anlog or digital style. The communication unit 20Gmay be mounted externally, instead of being enclosed in the device, asshown in FIG. 4. It is through this communication unit 20G that thesponsorship request is transmitted. The communication unit 20G may alsobe used for communication with the membership database 21, as necessary.

The operating input unit 20H is used for inputting the content of thesponsorship request or imparting various commands to the device forinputting the sponsorship request conditions 20. The operating inputunit 20H may be exemplified by a keyboard, a mouse, a pointing device,such as pad, pen or pointer, a dial, including one having a clickfunction, a pressing button key etc. The bus 20I is a datainputting/outputting bus and may be exemplified by an ISA bus, an EISAbus and a PCI bus.

The displaying means 20J is used for displaying the information, such assponsorship request conditions. FIG. 4 shows a case where a deviceenclosed in a casing different from one for the device for inputting thesponsorship request conditions 20, for example, a display unit of amonitor device or a TV receiver, is connected as the display means. Asaforesaid, the displaying means 20J and the device for inputting thesponsorship request conditions 20 may be provided in the same casing.

Meanwhile, the connection system in case of providing the respectivecomponents making up the device for inputting the sponsorship requestconditions 20 outside of the main body unit of the device may bewireless, such as with Bluetooth, in place of wired connection.

The device for inputting the sponsorship request conditions 20 shown inFIG. 4 may be exemplified by computer terminals, such as notebook ordesktop personal computers, PDA, portable telephone sets, game machines,set top boxes, PC cards, domestic electrical utensils, VTR, televisionreceivers, car navigation systems, wrist watches having the informationprocessing functions, distribution terminals for music or games,financial terminals (ATM) etc., in addition to the so-called dedicatedterminals.

The structure of the membership database 21 or the terminal forregistered members 22, connected to the device for inputting thesponsorship request conditions 20 over the telephone network or a datanetwork, will be explained in detail subsequently. Meanwhile, theinformation registered in the membership database 21, inclusive of thedesired conditions for distribution 21A, will be explained later inconnection with the explanation of the sponsorship transaction brokerageserver.

Reference is now made to FIG. 5 showing a device for inputting thesponsorship request conditions 20, which is different from the deviceshown in FIG. 4 in that the membership database 21 is provided on theside sponsor business operator. Although the membership database 21 isprovided in the casing of the device for inputting the sponsorshiprequest conditions 20, it is not mandatory that the membership database21 be enclosed in this manner such that it may also be connectedexternally of the casing. The difference of the configuration of FIG. 5from that of FIG. 4 is that the management entity of the membershipdatabase 21 is the sponsorship requesting party.

Although the registration of the information concerning the sponsorbusiness operator is usually made by the sponsorship requesting party,it is also possible for a sponsor business operator willing to agree tothe sponsorship request to make individual registration over thenetwork. The same applies for a case where the sponsor business operatorhas a desired condition for distribution with respect to the distributedsponsorship request. As in the case of FIG. 4, the informationregistered in the membership database 21 will be explained in detaillater in connection with the explanation on the brokerage server.

(a-2) Input Form Picture

FIG. 6 shows an example of a sponsorship request condition inputtingform. Such a favorable effect may be expected that, by simply enteringthe information in the inputting form, it is possible to create awritten request (request data) having the necessary minimum nameinformation. In the current state of network development of today, thissort of the sponsorship request may possibly be made not only in thesponsorship transaction between undertakers or operators, but alsobetween operators and individuals and between individuals. So, thenecessity is keenly felt for this sort of the interfacing technology.

An inputting form 25 of FIG. 6 has, as its input terms, a project name25A, time and date of execution 25B, project content 25C, a target 25D,desired conditions for sponsorship 25E to 25G, desired amount 25H andinput columns 25I for each input item. A transmission button 25J is alsoindicated on the display picture.

Among the items to be entered in the input item ‘project’, there are,for example, creation of picture programs, including televisionprograms, motion picture programs, in turn including those played in atheater, and other programs, creation of radio programs, ads, businessschemes, creation of games, various events, including exhibitions,sports, contests, territorial PRs and festivals, various funds andvarious organizations. Of course, one or more of these items is enteredin creating the sponsorship request.

As items to be entered in the ‘date and time of execution’, the date andtime of project execution and broadcast time zones are entered. As itemsto be entered in ‘content of input items’, the project name, such asprogram name, name of a supervisor, objective, such as purport or themeof the project, date and time, that is date and time of execution orairing, site, such as site of execution or airing area, are input. Asitems to be entered in ‘target (target layer)’, territory, age groups,sex, revenue, property etc. are entered. As items to be entered in‘desired conditions for sponsorship’, commodities or services, quantity,date and time (date and time of execution or use), site (site of use ofdelivery), amount, conditions of use, conditions of distribution of thesponsorship request (fields of business, specified groups, specifiedpersons, specified territories, inclusive of GPS information) and soforth, are entered. As items to be entered in [desired amount], pricesfor furnishment of the commodities or services, desired in the sponsor,are entered. Alternatively, this item can be entered as part of thedesired conditions for sponsorship.

Since these input items represent the crucial information in theregistered member(s) judging whether or not the sponsorship request isto be agreed to, it is desirable to use the information optimized inconformity to the aim in view. In making an entry with a keyboard in therespective input columns 25I for respective input items, selective entrymay be made from respective input item examples displayed in therespective input items.

Meanwhile, when a transmission button 25J is pressed (clicked) after theentry in the totality of items or the basic information, the informationrecorded in the input data recording unit 20C is distributed to thedestination of distribution decided on by the distribution destinationspecifying unit 20D. The technique of deciding on the destination ofdistribution is as described above.

(a-3) Data of Sponsorship Request Conditions

FIG. 7 shows a typical structure of data of sponsorship requestconditions 26 transmitted from the device for inputting the sponsorshiprequest conditions 20 to the terminal for registered members 22.

The data of sponsorship request conditions 26 is made up of themanagement ID information 26A, the client information 26B, transmissiondestination information 26C, client name information 26D, a project name26E, date and time of execution 26F, project content 26G, target layerinformation 26H, desired conditions for sponsorship 26I and otherinformation.

The management ID information 26A is the identification information forthe sponsorship client or the broadcast business operator to oversee thesponsorship request. The client information 26B is the information forspecifying the origin of transmission of the sponsorship request on thenetwork, as typified by URL, E-mail address or telephone number. Thetransmission destination information 26C, which is the information forspecifying the destination of transmission of the sponsorship request onthe network, holds the information similar to the client information26B. Meanwhile, the information registered in the membership database 21and which is pertinent to the registered members determined as thedestination of distribution by the distribution destination specifyingunit 20D, is used as the transmission destination information 26C.

The information registered as the sponsorship client is written in theclient name information 26D. Alternatively, the information can beentered in the inputting form of FIG. 6. For the project name 26E, dateand time of execution 26F and the project content 26G, the items enteredin the inputting form 25 are duplicated and used. For the target layerinformation 26H, desired conditions for sponsorship 26I, the itemsentered in the inputting form 25 are duplicated and used. It is notedthat the desired conditions for sponsorship 26I may be associated witheach of the desired conditions for sponsorship, entered with theinputting form 25, or plural desired conditions for sponsorship may begrouped in one.

(a-4) Processing Operations in Making Sponsorship Request

FIG. 8 shows an inputting processing sequence of sponsorship request inthe device for inputting the sponsorship request conditions 20. When theexecution of the application program for executing the function inquestion is commanded, the controller 20F causes the inputting form tobe read out from the input form recording unit 20B (step S1). Theapplication program is stored in a recording medium or a storage medium,not shown. The controller 20F expands the so read-out inputting form onthe display controller 20A to output the input form in a preset signalformat (data format) on the display means 20J. As a result, theinputting form is determined by the display-means 20J on the displaypicture (step S2).

The sponsor client, including an operator, checks the input itemsdisplayed, and sequentially inputs the project name, in need of sponsor,date and time of execution, sponsorship conditions, including theinformation on the commodities or services desired to be requested.During this time interval, the controller 20F gives a decision as towhether or not the inputting of the necessary minimum information hascome to a close (step S3). Specifically, the controller verifies whetheror not the transmission button 25J has been depressed to make thedecision. That is, when the transmission button 25J has been depressed,the controller verifies that the inputting has become final. That is, anaffirmative result is obtained as being the result of decision. Ifconversely the transmission button 25 j has not been depressed, thecontroller verifies that the inputting has not become final. That is, anegative result is obtained as being the result of decision.

Alternatively, the decision may be effectuated only when the thetransmission button 25J has been depressed. That is, it is verifiedwhether or not the necessary minimum information has been input, withthe actuation of the transmission button 25J as a trigger, and anaffirmative result or a negative result may be produced when thenecessary item has been entered or when there is any non-entered item,respectively.

When the affirmative result is obtained, the controller 20F affords theinformation pertinent to sponsorship request to the distributiondestination specifying unit 20D to execute the processing of identifyingthe destination of distribution of the sponsorship request (step S4).When the destination of distribution is decided on by this processing,the controller 20F appends the management ID information to theinformation input using the inputting form to prepare transmission data(step S5). Subsequently, the controller 20F stores the transmission dataprepared and distributes the data through the communication unit 20G. Bythis processing, the sponsorship request is distributed to a reasonablearea of the sponsor business operators (registered members) ready tofurnish the commodities or services.

(b) Response Result Receiving Device

(b-1) Terminal Structure

FIG. 9 shows an embodiment of a response result receiving device havingthe function of confirming the response data notified by the registeredmember conforming to the sponsorship request. Meanwhile, the responseresult receiving device is routinely implemented on the same terminal asthat of the sponsorship request condition inputting device. So, theparts or components common to those shown in FIGS. 4 and 5 are depictedby the same reference numerals. FIG. 9 shows the case where thecross-sectional view support system is mainly made up by three parties,namely a sponsor client, a brokerage business operator and registeredmembers.

The response result receiving device 30 includes a display controller20A, a display form recording unit 30A, a response data recording unit30B, a controller 20F, a communication unit 20G, an operating input unit20H, a bus 20I and display means 20J. Although the display means 20J andthe operating input unit 20H are provided outside the casing in FIG. 9,these may be provided within the casing, as the main body unit, as inthe case of the device for inputting the sponsorship request conditions20. Similarly, the various recording or communication units, provided inFIG. 9 within the casing, as the main body unit of the device, may beprovided outside the casing.

The display form recording unit 30A is a recording medium or storagemedium in which to record the display form of the response results. Itis noted that the medium may also be used for recording or storage ofother information, there being no necessity of using the medium solelyfor the display form of the response results. The medium may beexemplified by a CD-ROM, a magnetic recording medium, such as tape,floppy disc, hard disc or a magnetic card, an optical recording medium,such as write-once CD, DVD or optical card, a magneto-optical recordingmedium, such as DVD, MD or MO, a semiconductor memory, such asnon-volatile memory or RAM.

The response form recorded will be explained later in detail. Theresponse form may be pre-fixed on the medium, duplicated from otherrecording mediums or downloaded over communication network, such asInternet. The response form may be expanded on a video RAM provided ine.g., the display controller 20A.

The response data recording unit 30B is a recording or storage mediumfor recording data input through the operating input unit 20H formanagement purposes. Although a RAM is usually employed as this medium,any sort of the recording medium may be used provided that input datacan be written therein. There is no necessity for the response datarecording unit 30B to be used exclusively for recording input data. Forexample, the response data recording unit 30B may be realized with themedium which is physically the same as the display form recording unit30A, using a recording area distinct from that for the display formrecording unit. Meanwhile, the display form recording unit 30A and theresponse data recording unit 30B may be provided within the inside ofthe display controller 20A.

Meanwhile, in FIG. 9, the membership database 21 is not provided on theside sponsor client because it is here assumed that the sponsorshiptransaction support system is made up mainly by three parties. If thesponsorship transaction support system is made up mainly by two parties,the membership database 21 is provided on the side sponsorship client.In this case, the sponsorship request conditions etc. are recorded inthe final form in the membership database 21 along with the managementID information for sponsorship request.

(b-2) Response Result Confirmation Form Picture

FIG. 10 shows an example of a response result confirmation form picture.Since the necessary minimum items in checking the response results tothe sponsorship request are indicated in the response resultconfirmation form picture, the response results can be executed easily.Moreover, since the display items of the response results aredemonstrated in the confirmation form, the response content can bemanaged readily. That is, for the client receiving many responsecontent, it may be easier to compare the results of the response contentor to grasp the content. In particular, since the sponsorship requestmay be expected to be made not only in the sponsorship transactionbetween different operators, but also between the operator and theconsumer and between the individuals, the necessity for theabove-mentioned interfacing technology is being felt keenly.

The confirmation form 31 of FIG. 10 has, as its display items, the namesof responders 31A, the name of the client 31B, project name 31C,commodities or services that can be offered for sponsorship 31D,sponsorship conditions 31E to 31G, requested amount 31H and displaycolumns 31I for the respective display items. There is also displayed aconfirmed state indicating button 31J.

The client name 31B and the project name 31C are the information mainlyused by the client in confirming the sponsorship request. The names ofresponders 31A and the commodities or services that can be offered forsponsorship 31D are useful in confirming the operator who has acceptedthe sponsorship request and to what the response has been made. In thesponsorship conditions 31E to 31G, the same information as that at thetime of sponsorship request is usually displayed. Should any change beproduced in this information, the display color is desirably changed byemploying a corresponding function in combination. Meanwhile, when thisfunction is to be implemented, it is sufficient if the sponsorshipcondition as held is compared to the sponsorship condition as receivedas to possible coincidence to send the result of decision to the displaycontroller 20A or to the controller 20F.

In the amount requested 31H, the price requested by the businessoperator agreeing to the sponsor is displayed. Meanwhile, if this itemonly can be input by the registered members, condition comparison may bemade easily in case plural responses are made to the same sponsorshiprequest. When the sponsorship transaction is to be validated for thecontent of the above display item, it suffices to depress the confirmedstate indicating button 31J.

(b-3) Response Result Data

FIG. 11 shows an illustrative structure of response result data 32transmitted from the terminal for registered members 22 to the responseresult receiving device 30.

The response result data 32 is made up by the management ID information(responder side) 32A, the management ID information (client side) 32B, aresponse source information 32C, a transmission destination information32D, the name of the registered members 32E, content of commodities orservices that can be offered for sponsorship 32F, sponsorship conditioninformation 32G and other information.

The management ID information (responder side) 32A, appended by theregistered member accepting the sponsorship request, is theidentification information used not only by the registered member butalso by the brokerage business operator or by the client receiving theresponse result for supervising the response result data. On the otherhand, the management ID information (client side) 32B is theidentification information used by e.g., the client receiving theresponse results in supervising the sponsorship request.

The response source information 32C, specifying the transmission sourceof the response result on the network, may be exemplified by URL, E-mailaddress or the telephone number. The transmission destinationinformation 32D specifies the destination of transmission of thesponsorship request on the network. The information of the same sort asthe response source information 32C is held in the transmissiondestination information. Meanwhile, the information stated in the dataof the sponsorship request conditions 26 is used as the transmissiondestination information 32D.

In the name of the registered members 32E, the names of the registeredmembers accepting the sponsorship request are entered. This informationfacilitates identification of the business operator accepting thesponsorship request. By recording the information as separate items,data re-arraying or extraction can be carried out readily. An entry intothe content of commodities or services that can be offered forsponsorship 32F is made to permit the facilitated confirmation of thecommodities or services with which the business operator transmittingthe response result data agreed to the sponsor. The informationcorresponding to the desired conditions for sponsorship 26I isduplicated and entered in the sponsorship condition information 32G. Itis noted that, if the registered member accepting the sponsorshiprequest has made separate correction of the sponsorship conditions, theas-corrected information is recorded. In this case, the informationindicating the fact of the correction made is desirably stored incombination.

(b-4) Processing Operations on Receipt of the Response Results

On confirming the receipt of the response result data, the controller20F commands the execution of the application program for executing thefunction in question to cause the display form to be read out from thedisplay form recording unit 30A. In this case, the application programis again stored in the recording or storage medium, not shown. Onreceipt of the response result data, the controller 20F causes thereceived response result data to be recorded in the response datarecording unit 30B.

The controller 20F causes the response result data and the display formto be read out and routed to the display controller 20A to expand theinformation so read out in a display RAM provided in the displaycontroller 20A. In case of non-coincidence of the read-in responseresult data with the item of the display form, the controller 20Fspecifies a site in which to embed the response result data. Theinformation expanded on the display controller 20A is output to thedisplay means 20J in a preset signal format (data format). As a result,the content of the response result data 32 is displayed as an overviewon the display picture. If there are plural response result data 32,these may be displayed sequentially or simultaneously on one displaypicture.

When the content of the response result data are confirmed and thebusiness operator who is to validate the sponsorship transaction isdetermined, the confirmed state indicating button 31J is operated on thedisplay picture for the response result data received from the businessoperator. When a button for validating the sponsorship transaction isprovided separately from the confirmed state indicating button 31J, theformer is pressed. At any case, if the operation is finally determinedby button actuation, the finally determined information is recorded on arecording medium, not shown, or in the response data recording unit 30B,whilst the fact of validation is registered in the membership database21.

The fact of validation of the transaction is notified, either directlyor indirectly, to the registered member for whom the sponsorshiptransaction has become valid. Preferably, the fact of non-validation ofthe sponsorship transaction is notified to the registered member(s) forwhom the sponsorship transaction has not become valid.

(B-2) Terminal of the Sponsorship Transaction Brokerage BusinessOperator

(a-1) Terminal Structure

FIG. 12 illustrates an embodiment of a brokerage transaction brokerageserver acting as a broker for sponsorship transaction. Meanwhile, thebrokerage transaction brokerage server is used in case the sponsorshiptransaction support system is constructed by three parties, namely thesponsor client, brokerage business operator and registered members.

It is noted that the membership database 21 in FIG. 12 is the same asthe membership database 21 used in the explanation on the device forinputting the sponsorship request conditions 20. In the case of FIG. 12,the membership database 21 is provided within the casing of asponsorship transaction brokerage server 35. However, it is naturallynot mandatory to provide the membership database in the same casing asthat of the main body unit. For example, the membership database may beprovided on the network. It is sufficient if a sole system is virtuallyconstructed over a network. The same holds for other functional units.The network may be wireless, instead of being a cable network.

The sponsorship transaction brokerage server 35, shown in FIG. 12, ismade up by a controller 35A, a specifying rule recording unit 35B, adistribution destination specifying unit 35C, a distributing section35D, a sponsor pre-registration accepting unit 35E, a pre-registrationcondition decision unit 35F, a communication unit 35G and a bus 35H.Meanwhile, this construction is used when the brokerage businessoperator decides on the destination of distribution of the sponsorshiprequest. If the decision on the destination of distribution of thesponsorship request is to be made at the client terminal, thesponsorship transaction brokerage server is made up by the controller35A, membership database 21 and the communication unit 35G. Theconstruction of various components is hereinafter explained.

The controller 35A represents means for controlling various componentsmaking up the sponsorship transaction brokerage server 35. In general,the controller is of the micro-computer configuration. The functions ofthe controller 35A are usually prescribed by the operation systemprogram and by the application program. In the present embodiment, thesponsorship transaction brokerage server 35 also executes the processingof registering the responses to the sponsorship request sent from theregistered members in the membership database 21 and the processing ofaccepting the sponsor client.

Meanwhile, a dedicated processor for executing the functions, that is, aresponse result data receiver for receiving the response to thesponsorship request, a response result data registration unit forregistering the response result data in the membership database 21 and aresponse result data transmitter for sending the response result data toa destination of transmission entered in the data, may be used. It is tobe noted that these functions are implemented as the functions of thecontroller 35A. Additionally, the server also performs the processingoperation of registering the information on the finally determinedsponsorship transaction in the membership database 21.

The specifying rule recording unit 35B is equivalent to the specifyingrule recording unit 20E of the device for inputting the sponsorshiprequest conditions 20 (FIG. 4). On the other hand, the distributiondestination specifying unit 35C is equivalent to the distributiondestination specifying unit 20D of the device for inputting thesponsorship request conditions 20 (FIG. 4). Consequently, the foregoingexplanation on the specifying rule recording unit 20E and thedistribution destination specifying unit 20D is valid for the specifyingrule recording unit 35B and the distribution destination specifying unit35C, respectively.

The specifying rule recorded in the specifying rule recording unit 35Bis assumed to be that created or edited by the brokerage businessoperator. In this case, the intention of the brokerage business operatorcan be reflected in the area of distribution of the sponsorship request.By and large, the information concerning the state of response and thetendency to agreement conclusion for the past area of distribution isstored in the brokerage business operator, and hence the area ofdistribution may be expected to be optimized. It is noted that thespecifying rule may be that created or edited on the part of thesponsorship client, in which case the client's intention may bereflected in the area of distribution of the sponsorship request.

The distribution destination specifying unit 35C retrieves themembership database 21 based on the specifying rule recorded in thespecifying rule recording unit 35B to implement the function ofidentifying the registered member having to do in some way or directlywith the sponsorship request. In this case, the membership database 21may be retrieved by the distribution destination specifying unit 35Cdirectly controlling the membership database 21, or by sending only thenecessary information to the membership database 21 to receive only theretrieved results.

Meanwhile, in the case of FIG. 12, the pre-registration conditiondecision unit 35F is present in the sponsorship transaction brokerageserver 35, such that the decision processing needs to be executed priorto the processing of specifying the destination of distribution. So, theoperation on receipt of the sponsorship request partially differs fromthe foregoing explanation. The operation on receipt of the sponsorshiprequest will be explained subsequently.

The sponsor pre-registration accepting unit 35E and the pre-registrationcondition decision unit 35F represent means operating so that, when theintention of the business operator requesting the sponsor is in keepingwith that of the responding business operator, the transaction with thetwo business operators is preferred to transactions between otherbusiness operators. By the way, the processing of specifying thedestination of distribution based on the specifying rule representsmeans for optimizing the area of distribution of the sponsorshiprequest. The sponsor pre-registration accepting unit 35E and thepre-registration condition decision unit 35F may be provided in thedevice for inputting the sponsorship request conditions 20.

The sponsor pre-registration accepting unit 35E represents means forpre-registering, in the membership database 21, the conditions desiredwhen the registered member willing to accept the sponsorship requestaccepts the sponsorship request. By and large, the content of theregistration need not be identical with but may be completely equated tothe sponsorship request conditions input by the device for inputting thesponsorship request conditions 20. The information for registration willbe explained subsequently.

The pre-registration condition decision unit 35F is informationprocessing means for implementing the function of verifying orretrieving, on receipt of the sponsorship request, and prior to decisionon the destination of distribution of the sponsorship request, whetheror not there is any registered member who has registered the conditionsatisfying the sponsorship request in question. The pre-registrationcondition decision unit 35F is configured for retrieving the membershipdatabase 21 based on the sponsorship request received through thecommunication unit 35G to verify the possible presence of thepre-registration information which accords with the conditions of thesponsorship request.

The decision here is basically the coincidence detection. As forsponsorship conditions that can be expressed quantitatively, forexample, the amount requested or quantity, the pre-registrationinformation in meeting with the sponsorship request conditions is deemedto be present in case the conditions are more favorable to the clientthan the sponsorship condition, for example, in case the amountrequested is lower than the amount stated in the sponsorship request, orin case the quantity is larger than that stated in the sponsorshiprequest. If the number of the requirements of the sponsorship requestreceived is larger than that of the sponsorship condition registered, adecision is given that the sponsorship request conditions are met whenthe requirements of the sponsorship request are met as concerns theregistered requirements.

When there is any registered member meeting the sponsorship request, thepre-registration condition decision unit 35F notifies both theregistered member in question and the sponsorship client that there arethe counterparties who are in meeting with the two without executing theprocessing of identifying the destination of distribution. In this case,the conditions requested by the counterparties are notified. If thenumber of the registered member satisfying the sponsorship request issingular, it is theoretically possible to assume that the transactionhas been concluded at this time point. However, since this is the resultof mechanical detection of coincidence, the sponsorship transaction isdesirably concluded subject to agreement between the two parties advisedof the fact of the coincidence detection. Conversely, when there is noregistered member satisfying the sponsorship request, thepre-registration condition decision unit 35F operates for sending thereceived sponsorship request to the distribution destination specifyingunit 35C.

Similarly to the control unit 20G in the device for inputting thesponsorship request conditions 20, the communication unit 35G representsmeans for communication with outside over the network. So, acommunication equipment conforming to the network is used as thecommunication unit 35G. The types of the networks usable are asdescribed above. The communication unit 35G may be mounted externally,instead of being enclosed, as shown in FIG. 12. The sponsorship requestand the response from the registered member etc. are transmitted overthis communication unit 35G. The communication unit may also be used forcommunication with the membership database 21, as necessary.

The bus 35H is a data input/output bus, and may be exemplified by, forexample, an ISA bus, a EISA bus and a PCI bus. Although the operatinginput unit or the display means are not shown in FIG. 12, there areprovided components equivalent to the operating input unit 20H and thedisplay means 20J of FIG. 4.

The membership database 21 and the desired conditions for distribution21A will be explained separately later in detail. Meanwhile, thesponsorship transaction brokerage server 35, shown in FIG. 12, may beexemplified by computer terminals, such as notebook or desktop personalcomputers, PDA, portable telephone sets, game machines, set top boxes,PC cards, domestic electrical utensils, VTR, television receivers, carnavigation systems, wrist watches having the information processingfunctions, distribution terminals for music or games, financialterminals (ATM) etc., in addition to the so-called dedicated terminals.

(a-2) Membership Database

FIG. 13 shows an illustrative data structure of the membership database21. The membership database 21 is made up of storage means, comprised ofa large capacity recording or storage medium, a communication unit forhaving communication with outside, and a controller supervising theentire system, such as a computer system comprised of a micro-processor,RAM, ROM, and an input/output unit. The large-capacity recording mediummay be exemplified by a magnetic disc, such as a hard disc, amagneto-optical disc, such as MO, an optical disc, such as DVD and asemiconductor memory.

The membership database 21 is made up of desired conditions fordistribution 21A, management information 21B to 21L, goods-relatedinformation 21M to 21R, service-related information 21Q to 21S,conditions under which the sponsorship request 21T is responded to, andother information. There may be a system in which the desired conditionsfor distribution 21A are not registered. In a system adapted forregistering the desired conditions for distribution 21A, it is up todiscretion of the sponsor business operator whether or not theinformation in question is to be registered.

In the following explanation, such a system is presupposed whichregisters the desired conditions for distribution 21A. The desiredconditions for distribution 21A represent the information correspondingto the content of the sponsorship request distributed and which arepre-registered by the registered members (sponsor business operators) asthe recipients of the sponsorship request. For example, the informationon the commodities or services that can be offered for sponsorship, theinformation specifying the sponsorship client, time (time of furnishmentor execution etc.) or place (place of furnishment or execution, place ofresidence of the counterparty etc.) is registered.

The desired conditions for distribution 21A operate as the requirementsfor further narrowing the area of distribution as specified by thegeneral registration information (such as management information,goods-related information or the service-related information) ratherthan as specified sponsor accepting requirements pertinent to theindividual commodities or services as under the conditions 21T underwhich the sponsorship request is accepted. Meanwhile, the generalregistration information is pre-registered by the registered members orby the brokerage business operator.

The management information may be exemplified by the management IDinformation 21B, registration date information 21C, updating dateinformation 21D, registrant name information 21E, business sortinformation 21F, place of residence information 21G, telephone number21H as the contact site information, mail address information 21I, URLinformation 21J, GPS information 21K, mail number information 21L etc.

The management ID information 21B is the information for specifying asequence of the information. The registration date information 21C andthe updating date information 21D represent the data managementinformation. The registrant name information 21E is the name of theregistered member as an entity of the sponsorship transaction. Thebusiness sort information 21F is the recorded information concerning themain business sorts of the registered members. This information operatesas an index in specifying the area of distribution of the sponsorshiprequest. In general, it is the registered member that makes thisregistration. However, the brokerage business operator sometimes makesthis registration. The place of residence information 21G generallyrecords the information concerning the place of residence of the mainoffice and branch offices to which belong staff members in charge of theprocessing of the sponsorship transaction. This information alsooperates as an index in specifying the area of distribution of thesponsorship request.

The telephone number 21H is the information used by the brokeragebusiness operator and the sponsorship request in making a telephonecall. The mail address 21I is used as the address information for makingsponsorship request or the relevant communication over the network. TheURL information 21J is the information for the registered member toaccess the information laid open by the registered members. The GPSinformation 21K is used for displaying the information pertinent to theplace of residence or the site of furnishment on an electronic map. Thisinformation may also be used as an index in specifying the area ofdistribution of the sponsorship request. The information may beregistered as a site of destination in the car navigation system tovisit the counterparty. The mail number 21L is also effective as theinformation used for narrowing the site of residence etc.

The goods-related information and the service-related information areindividually registered for what the registered member is willing tosupply or the goods handled by the registered member. That is, whenthere are plural goods or services to be registered, a number of sets ofthe information corresponding to the number of the commodities orservices in question are recorded. As the goods-related information, theinformation on the site of furnishment of the commodities or services21M, the information on the classification of the commodities handled21N, the information on the names of the commodities handled 21O or theinformation on the names of producers 21P etc. are recorded. As theservice related information, the information on the site of furnishment21Q, the information on the code of services handled 21R and theinformation 21S on the names of services handled, are recorded.

As the site information for furnishing the commodities or services, theinformation associated with individual commodities or services isrecorded. The information on the classification of the commoditieshandled 21N or the information on the code of services handled 21Rrepresents the information beneficial to processing on the computer andis desirably appended on the basis of a unified standard, such as JIS.As the information on the code of services handled 21R and theinformation 21S on the names of services handled, the trademarks used bythe registered members furnishing the commodities or services, forexample, are recorded. However, the generic appellation of thecommodities or services may also be used. The name of the producer 21Ris the information on the producer. Although the information associatedwith services is not registered, the name of the party directlyfurnishing services is recorded in case the registered member is theparty acting as intermediary for the services.

The conditions under which the sponsorship request is accepted 21Trepresent the information for the registered member to registerspecified conditions in case the registered member accepts thesponsorship request relevant to specified commodities or services. Thisinformation is the information registered by the sponsorpre-registration accepting unit 35E and referenced by thepre-registration condition decision unit 35F who has received thesponsorship transaction. As aforesaid, the conditions under which thesponsorship request is accepted 21T are usually registered for itemssimilar to the input items of the sponsorship request.

(a-3) Processing Operation

The content of the brokerage operations executed by the sponsorshiptransaction brokerage server is hereinafter explained for respectivecases. In the following explanation, the sponsorship transactionbrokerage server 35 is assumed to have the structure shown in FIG. 12.

(1) On Pre-Registration of the Sponsorship Conditions

On receipt from the terminal for registered members 22 of a noticehaving the conditions under which to accept the sponsorship request asdata content, the controller 35A sends the notice to the sponsorpre-registration accepting unit 35E. The sponsor pre-registrationaccepting unit 35E retrieves the membership database 21, with theinformation of the registered member who issued the notice as the clueto add the conditions under which to accept the sponsorship request 21Tas the registration information of the relevant registered member. Thisaddition of the information is carried out for each individual commodityand service. The information may also be individually deleted onnotification from the registered member. By employing the information,the registered member is able to set the condition adapted to the marketstatus. It is however up to the registered member whether theinformation is to be used for short-term transaction purposes or forlong-term purposes.

(2) On Receipt of Sponsorship Request

FIG. 14 shows the processing sequence executed in case the sponsorshiptransaction brokerage server 35 receives the sponsorship transaction. Onascertaining the receipt of the sponsorship request from the sponsorshipclient, the controller 35A captures the sponsorship request conditionsof the sponsorship request in a storage area, such as RAM, not shown,while notifying the receipt of the sponsorship request to thepre-registration condition decision unit 35F (step S11).

The pre-registration condition decision unit 35F verifies whether or notthere are those conditions in meeting with the content of thesponsorship request among the conditions 21T which are registered in themembership database 21 and under which the sponsorship request isaccepted (step S12). If there is one or more pre-registered informationthat is in meeting with the sponsorship request, the affirmative resultsare obtained, so that the processing transfers to step S13. If there isno pre-registered information that is in meeting with the sponsorshiprequest, a negative result is obtained, so that processing transfers tostep S14. It is noted that the negative result is obtained in case theconditions which are in meeting with the sponsorship request 21T areregistered for none of the registered members.

When the processing has transferred to step S13, the pre-registrationcondition decision unit 35F notifies to both the registered member whohas pre-registered the conditions which are in meeting with thesponsorship request and the client who issued the sponsorship requestthat the counterparties are present who are able to meet the conditionsof the opposite side parties. This notice is made through thecommunication unit 35G. The processing operations in case thesponsorship transaction is finally determined for the notification willbe explained subsequently.

When the processing transfers to step S14, the processing operation istransferred from the pre-registration condition decision unit 35F to thedistribution destination specifying unit 35C. The processing operationsin the distribution destination specifying unit 35C, now explained,similarly apply in case the function is provided at a terminal of thesponsorship client. The distribution destination specifying unit 35Creads out the specifying rule used for specifying the destination ofdistribution from the specifying rule recording unit 35B to retrieve themembership database 21 based on the so read-out specifying rule. Thedistribution destination specifying unit 35C then executes retrieval onthe generic registration information (management information,goods-related information and service-related information) from amongthe information registered in the membership database 21.

So, the distribution destination specifying unit 35C finally determinesthe registered members to whom the sponsorship request is to bedistributed (step S16). Usually, the registered members in meeting withthe specifying rule are extracted as the destination of distribution ofthe sponsorship request. If there is no registered member in meetingwith the specifying rule, the totality of the registered membersregistered in the membership database-21 are finally determined as thedestination of distribution of the sponsorship request.

The distribution destination specifying unit 35C verifies whether or notthe desired conditions for distribution 21A have been registered for theregistered members finally determined as the destination of distribution(step S16). When the affirmative result is obtained, that is when thereexist the desired conditions for distribution 21A, the distributiondestination specifying unit 35C verifies whether or not the sponsorshiprequest also meets the desired conditions for distribution 21Aregistered by the respective registered members. The distributiondestination specifying unit extracts only the members in meeting withthe desired conditions for distribution 21A (step S17). If converselythe negative result is obtained, that is if there are no desiredconditions for distribution 21A, the distribution destination specifyingunit 35C skips the step S17. That is, since there is no reason for notdistributing the sponsorship request to the registered member(s) whosatisfy the above condition, the registered member(s) is finallydetermined at this stage to be comprised within the area ofdistribution.

When the ultimate area of distribution is finally determined, thedistribution destination specifying unit 35C distributes the sponsorshiprequest to the finally determined registered member(s) (step S18). Atthis time, the distribution destination specifying unit 35C notifies thepresence of the information using the mail address information 21Iregistered in the membership database 21. It is noted that, if the faxnumber is registered, call may be made by fax. The above completes theprocessing of distributing the sponsorship request.

(3) On Receipt of the Response Result Data

On receipt of a notice having as data content the reply result forsponsorship request from the registered member who has received thesponsorship request, the controller 35A causes the content of the noticeto be registered in the membership database 21. It is noted that thereare two responses, namely the response agreeing to the sponsorship andthe response not agreeing to the sponsorship. This registeredinformation may be used in specifying the destination of distributionfor subsequent sponsorship requests. For example, if the responseresults to similar sponsorship request indicate non-agreement to thesponsorship, the registered member(s) who made the response may beomitted from the group of the succeeding destination of distribution.

Since it may be probable that the previous sponsorship was onlyfortuitously not agreed to, such omission is desirably made only in suchcase where there is annexed the information to the effect thatdistribution of the sponsorship request of the same sort is nothenceforth desired by the registered members, in order to make much ofthe goodwill on the part of the registered members.

The controller 35A selectively sends the affirmative response results tothe client. The controller 35A at this time transmits data based on theinformation on the destination of transmission annexed to the responseresult data 32 or the liaison site information of the sponsorshiprequest as specified from the management ID information. It is notedthat, at this time point, plural response result data 32 are transmittedto the sponsorship request.

(4) On Receipt of the Notification of Registered Results

On receipt from one or both of the terminal of the sponsorship request20 and the terminal for registered members 22, indicating the conclusionof the finally determined sponsorship transaction, as data content, thecontroller 35A registers the content of the notification in themembership database 21.

This registration information is used for specifying the area ofdistribution of the next and following sponsorship transactions or asthe management information for the project as the object of sponsor. Forexample, when the subject-matter of the sponsorship is the creation ofthe picture program, the registered information may be furnished as dataancillary to the program to the program producer. Since the data can beextracted, the utilization efficiency of the information in question maybe improved. That is, such a wasteful incidence may be evaded in whichdata of the same content as viewed from the entire system is input anumber of times at different time points or places.

Thus, the membership database 21 not only is valuable for sponsorshiptransaction but also serves as a beneficial information source inbusiness transactions and for various projects. Meanwhile, if the datareadout from the membership database 21 is chargeable, it is possible tocollect the fee needed in the inputting or management.

Meanwhile, as the data fetching method from the membership database 21,transmission paths, wired or wireless, may be used, or a recordingmedium may be used. The recording medium may be enumerated by, forexample, magnetic recording type medium, such as tapes, floppy discs,hard discs or magnetic cards, optical recording mediums, such aswrite-once CD, DVD or optical cards, mediums of the magneto-optical disctype, such as DVD, MD or MO, and semiconductor memories.

(B-3) Registered Member's Terminal

In the case of constructing the sponsorship transaction support system,the functions directly relevant to the sponsorship transaction, such asthe functions of receiving the sponsorship request and transmitting theresponse of the registered members to the received sponsorship request,and the function for registration necessary for receiving thedistributed sponsorship request, are required of the terminal of theregistered member. In actuality, these functions are implemented in amajority of cases in one terminal. The following explanation is,however, made individually for clarifying the technological elementsnecessary for executing respective functions.

(a) Device for Receiving the Sponsorship Request

(a-1) Terminal Structure

FIG. 15 illustrates an embodiment of a sponsorship request receivingdevice 22 having the function of receiving the sponsorship request andthe function of accepting the request. The sponsorship request receivingdevice 22 includes a display controller 22A, a request contentconfirmation form recording unit 22B, a sponsorship request recordingunit 22C, a controller 22D, a communication unit 22E, an operatinginputting unit 22F, a bus 22G and display means 22H.

In FIG. 15, the display means 22H and the operating inputting unit 22Fare shown connected outside the main body unit of the device. However,the operating inputting unit and the display means may also be connectedas one to the main body unit of the device, as in the case of a notebookpersonal computer, a PDA and a portable telephone set. Although therecording unit and the communication unit are shown enclosed in the mainbody unit, these may also be connected to outside the main body unit. Inthe case of the external connection, connection may be wired orwireless. The structures of the respective functional units arehereinafter explained.

Similarly to the display controller 20A, the display controller 22A ismeans for reproducing and outputting the received or reproduced videodata in a signal format (data format) complying with the display means22H. As for the signal format and the decoding functions of the displaycontroller 22A, what has been said of the display controller 20Aapplies.

The request content confirmation form recording unit 22B is a recordingor storage medium for recording the confirmation form used fordisplaying the content of the sponsorship request. However, the mediummay be used simultaneously for recording or storing other informationwithout being used exclusively as an inputting form for sponsorshiptransaction. The medium may, for example, be a CD-ROM, a magneticrecording type medium, such as tape, floppy disc, hard disc or amagnetic card, an optical recording medium, such as write-once CD, DVDor optical card, magneto-optical recording type medium, such as DVD, MDor MO, and semiconductor memory, such as non-volatile memory or RAM.

The inputting form recorded will be explained later in detail. Theinputting form may be pre-fixed on the medium, duplicated from otherrecording mediums or downloaded over a communication network, such asInternet. The inputting form may be expanded on a video RAM provided ine.g., the display controller 20A.

The sponsorship request recording unit 22C is a recording or storagemedium for recording the sponsorship request condition data 26 receivedfrom the communication unit 22E. Meanwhile, the sponsorship requestcondition data and other information exchanged in connection with thesponsorship transaction may be data composed only of data shown in FIG.7, data stating the layout information (style sheet), as is the HTML(Hypertext Markup Language) file, or the XML (Extensible markupLanguage) file, in which the layout information (style sheet) isisolated from data.

The controller 22D is means for controlling various components making upthe sponsorship request receiving device 22 and for executing signalprocessing, and is generally of the micro-computer configuration. Thefunctions of the controller 22F are usually prescribed by the operationsystem program and by the application program.

Similarly to the communication unit 20G of FIG. 4, the communicationunit 22E is means for having communication with outside over a network.The network to be used is as described above with reference to FIG. 4.The operating inputting unit 22F is similar to the operating inputtingunit 20H of FIG. 4, while the display means 22H is similar to thedisplay means 20J of FIG. 4.

The sponsorship request receiving device 22 may be formed by computerterminals, such as notebook or desktop personal computers, PDA, portabletelephone sets, game machines, set top boxes, PC cards, domesticelectrical utensils, VTR, television receivers, car navigation systems,wrist watches having the information processing functions, distributionterminals for music or games, financial terminals (ATM) etc., inaddition to the so-called dedicated terminals.

(a-2) Confirmation Form Picture

FIG. 16 shows an example of a sponsor content confirmation form. If thisconfirmation form is used, the necessary minimum items in verifyingwhether or not the sponsorship transaction is to be made may bepresented in accordance with preset rule, so that the sponsor contentcan be confirmed and managed extremely readily. In particular, if theregistered member receives a large quantity of sponsorship requests, itbecomes possible to standardize the judgment. Moreover, as a result ofthe standardized items of confirmation, there may be provided a systemconvenient to use not only in sponsorship transaction among differentoperators, but also in sponsorship transaction between operators andindividuals and between individuals without regard to the age groups orsex of the users.

A confirmation form 36 shown in FIG. 16 includes, as display items, aclient 36A, a project name 36B, date and time of execution 36C, projectcontent 36D, a target 36E, desired sponsorship conditions 36F to 36H,desired amounts 36I and detailed information columns 36I correspondingto the display items. In the display picture, there are indicated abutton 36K operated when the sponsorship request is accepted, that isnot agreed to, and a button 36L operated when the sponsorship request isnot accepted, that is not agreed to.

In the columns 36I of the detailed information associated withrespective display items, the corresponding information in thesponsorship request condition data 26 received as the sponsorshiprequest is duplicated and displayed. For example, in the case of FIG.16, it may be seen that the client is [A-I-U Broadcasting Company], withthe project name being [Television Program ABCD]. It may also be seenthat the date and time of execution is [aired as from 2001, Jan. 3,21:00 until 22:00], with the project name being [what is likely to be invogue] and the target being [bachelor]. In the case of FIG. 16, thematerial collecting time is 2000 November, with the desired amount being0 yen (free of charge).

When such sponsorship request is agreed to, the sponsor businessoperator, inclusive of its staff members, acts on (clicks) the button36K. At this time, the response result data 32 shown in FIG. 11 istransmitted from the sponsorship request receiving device 22 to thebrokerage business operator or to the sponsorship client. If thesponsorship request is not agreed to, the sponsor business operator actson the button 32L. At this time, response result data, comprised of datastating non-agreement to the sponsorship request, is transmitted fromthe sponsorship request receiving device 22 to the brokerage businessoperator or to the sponsorship client.

If the number of the display items of the request content confirmationform 36 is lesser than that of the sponsorship request condition datareceived, the tenor to the effect that some of the information is notdisplayed is demonstrated on the display picture so that all informationcan be confirmed through other routes.

(a-3) Processing Operations

When the sponsorship request condition data 26 is received, thecontroller 22D displays the information contained in the data on thedisplay picture based on the request content confirmation form 36 storedin the request content confirmation form recording unit 22B. Meanwhile,if the request content confirmation form 36 is included in thesponsorship request condition data 26, the information is displayedusing the confirmation form. The request content confirmation form 36may be inseparably unified to the sponsorship request condition data 26,or may be contained therein separately and independently.

If the staff members of the business operator confirm the content of thesponsorship request on the display picture and feel that the sponsorshiprequest may be agreed to, the staff members input the effect of agreeingto the sponsor through e.g., an icon indicated on the display picture.The intention to agree to the sponsor is returned from the controller22D to the network. If otherwise, the staff members input that effectthrough e.g., an icon indicated on the display picture. This intentionof not agreeing to the sponsor is returned from the controller 22D tothe network.

(b) Registration Information Inputting Device

(b-1) Terminal Structure

Referring to FIG. 17, am embodiment of a pre-registration informationinputting device 39, having the functions of registration necessary toreceive the sponsorship request distributed, is now explained. Thepre-registration information inputting device 39 includes a displaycontroller 39A, a general item registration form recording unit 39B, asponsorship condition pre-registration form recording unit 39C, adesired distribution condition recording unit 39D, an input datarecording unit 39E, a controller 39F, a communication unit 39G, a bus39H, an operating input unit 39I and display means 39J.

In the case of FIG. 17, the display means 39J and the operating inputunit 39I are shown externally connected to the main body unit of thedevice. However, the operating input unit and the display means may beunified to the main body unit, as in the case of the notebook personalcomputer, a PDA or a portable telephone set. Additionally, the recordingand communication units, shown enclosed in the main body unit, may beconnected externally of the main body unit. In the case of the externalconnection, connection may be wired or wireless. The structures of therespective functional units are hereinafter explained.

Similarly to the above-described other display controllers, the displaycontroller 39A is means for reproducing and outputting the received orreproduced video data in a signal format (data format) complying withthe display means 22H. The same applies for the signal format and thedecoding functions of the display controller 39A.

The general item registration form recording unit 39B is a recording orstorage medium for recording the registration form relevant to generalregistration information recorded on the membership database 21, such asmanagement information, goods-related information or service-relatedinformation. However, the medium may be used simultaneously forrecording or storing other information without being used exclusively asregistration form. The medium may, for example, be a CD-ROM, a magneticrecording type medium, such as tape, floppy disc, hard disc or amagnetic card, an optical recording medium, such as write-once CD, DVDor optical cards, magneto-optical recording type medium, such as DVD, MDor MO, and a semiconductor memory, such as non-volatile memory or RAM.

The registration form recorded will be explained later in detail. Theregistration form may be pre-fixed on the medium, duplicated from otherrecording mediums or downloaded over a communication network, such asInternet. The registration form may be expanded on a video RAM providedin e.g., the display controller 39A.

The sponsorship condition pre-registration form recording unit 39C is arecording or storage medium for recording a registration form used forpre-registering the condition for sponsor business operators to agree tothe sponsorship in the membership database 21. This medium may again beused simultaneously for recording or storing other information withoutbeing used exclusively as registration form. Specified examples of themedium are similar to those of the general item registration formrecording unit 39B.

The registration form recorded will be explained later in detail. Theregistration form may be pre-fixed on the medium, duplicated from otherrecording mediums or downloaded over communication network, such asInternet. The registration form may be expanded on a video RAM providedin e.g., the display controller 39A.

The desired distribution condition recording unit 39D is a recording orstorage medium for recording the requirements for further narrowing thearea of distribution specified by the information on the generalregistration. This medium may again be used simultaneously for recordingor storing other information without being used exclusively forrecording the desired conditions for distribution. Specified examples ofthe medium are similar to those of the general item registration formrecording unit 39B.

Although the registration form recording unit for the desired conditionsfor distribution is not shown in FIG. 17, it is possible to use theregistration form for inputting the desired conditions. In such case, itsuffices if a registration form similar to the sponsorship requestcondition pre-registration form is used. Meanwhile, the desiredconditions for distribution are registered by the sponsor businessoperator, inclusive of its staff members, using the operating input unit39I.

The input data recording unit 39E is a recording or storage medium forrecording data input through the operating input unit 39I. For thismedium, what has been said for the above-mentioned mediums applies. Thatis, this medium may again be used simultaneously for recording orstoring other information without being used exclusively for recordingthe input data. Specified examples of the medium are similar to those ofthe general item registration form recording unit 39B.

The controller 39F is means for executing the control or signalprocessing of respective parts making up the pre-registrationinformation inputting device 39 and is generally of the micro-computerconfiguration. The functions of the controller 35A are usuallyprescribed by the operation system program and by the applicationprogram.

The communication unit 39G is means for communication with outside overa network. So, communication equipment that is in keeping with thenetwork is used. The network to be used is as described above. The bus39H is a data input/output bus and may, for example, be an ISA bus, anEISA bus, a PCI bus etc.

The operating input unit 39I is used for inputting the items ofregistration or imparting various commands to the pre-registrationinformation inputting device 39. The operating input unit 39I may beexemplified by a keyboard, a mouse, a pointing device, such as pad, penor pointer, a dial key, a pressing button key etc. The display means 39Jis a device used for displaying the sponsorship request conditions orother information. FIG. 17 shows a case where there is connected incircuit a display unit for a television receiver or a monitor device.

The pre-registration information inputting device 39, shown in FIG. 17,may be formed by computer terminals, such as notebook or desktoppersonal computers, PDA, portable telephone sets, game machines, set topboxes, PC cards, domestic electrical utensils, VTR, televisionreceivers, car navigation systems, wrist watches having the informationprocessing functions, distribution terminals for music or games,financial terminals (ATM) etc., in addition to the so-called dedicatedterminals.

(b-2) General Item Registration Form Picture

FIG. 18 shows an example of a general item registration form picture.The rudimentary information to be equipped in the membership database 21may be written simply on writing the information in the registrationform. In the current state of network development, in which thesponsorship request may be expected to be made not only in thesponsorship transaction between different operators, but also betweenthe operator and the consumer and between the individuals, the necessityfor an associated interfacing technology is being felt keenly.

The registration form 40 of FIG. 18 includes, as its input items, aregistrant name 40A, business sorts 40B, place of residence 40C, contactsite (telephone) 40D, contact site (mail address) 40E, contact site(URL) 40F, the GPS information 40G, place of furnishment 40H, name ofcommodities or services 40I, producer name 40J, and input columns 40Kcorresponding to respective input items. Meanwhile, the transmissionbutton 40L is also displayed on the picture.

These items are recorded in the aforementioned membership database 21(FIG. 13). The divisions of the commodities or services or the mailnumber may also be used as input items. Meanwhile, if a keyboard is usedas inputting means, examples of input entries represented in respectiveinput items may be selectively entered to respective input columns 40Kassociated with respective input items. If the transmission button 40Lis actuated (clicked), the information recorded in the input datarecording unit 39E is sent to a terminal which supervises the membershipdatabase 21.

(b-3) Sponsorship Condition Registration Form Picture

FIG. 19 shows an example of the sponsorship condition registration formpicture. By writing the information in such registration form,prioritized distribution may be guaranteed insofar as the sponsorshiprequest conditions are met. The items of the registration form aredesirably matched to those of the sponsorship request for use forverifying the coincidence to the input form of the sponsorship request.The use of such registration enables effective registration not only incase of sponsorship transaction between operators but in case ofsponsorship transaction between operators and individuals and betweenindividuals.

The registration form 42 of FIG. 19 includes, as its input entries,names of the sponsor 42A, commodities or services that can be offeredfor sponsorship 42B, sponsorship condition 42C to 42E, amount requested42F and input entries 42G associated with the respective input items. Atransmission button 42H is also indicated on the display picture.

These entries are recorded as the conditions under which to accept thesponsorship request 21T in the membership database 21 (FIG. 13).Meanwhile, if the keyboard is used as inputting means, examples of inputentries indicated in the respective input items may be selectively inputin the respective input columns 42G associated with the respective inputitems. If, when the transmission button 42H is operated (clicked), allentries or the basic information have been input, the informationrecorded in the input data recording unit 39E is sent to the terminal incharge of the membership database 21.

If the registration form of the same sort is used for registration ofthe desired conditions for distribution 21A, the registered informationis recorded as the desired conditions for distribution 21A in themembership database 21 (FIG. 13).

(b-4) Processing Operations

When commanded to register the general information for registration byan operator, the controller 39F causes a registration form 40 held inthe general item registration form recording unit 39B to be read out andsent to the display controller 39A for demonstration on the displaypicture of the display means 39J. The operator then inputs therudimentary information relevant to the sponsor business operator inaccordance with the input items displayed on the display picture. Theinput information is transiently stored in the input data recording unit39E. When the input is finally determined by the operation on thetransmission button 40L, the input information is sent to the membershipdatabase 21 through the communication unit 39G.

The processing of pre-registration of the sponsorship condition and theprocessing for registration of the desired conditions for distributionare similar to the processing of registration of the generalregistration information, with the sole difference being that theregistration form displayed on the display picture is changed to thesponsorship condition registration form 42.

(B-4) Summary

By constructing the sponsorship transaction support system, describedabove, it is possible to realize effective registration not only in caseof sponsorship transaction between operators but in case of sponsorshiptransaction between operators and individuals and between individuals.In particular, since the area of distribution of the sponsorship requestmay be freely changed in keeping with the intentions entertained by theclient, brokerage business operator and the sponsor business operator,there may be provided a system convenient to use for any of theparticipants in the sponsorship transaction. Moreover, the results ofthe sponsor, that is the access trends of the consumers to thesponsorship transaction or the number of the concluded sponsorshipagreements may be reflected, thus enabling the conclusion of projects ofhigh sponsorship effect and efficient furnishment of opportunities forpublicity or advertisements.

Additionally, the information stored in the sponsorship transaction maybe secondarily exploited in the subsidiary information data creatingsystem or in the digital picture program receiving and reproducingsystem, as later explained, to eliminate the deficiency of inputting theredundant information in the respective systems. In particular, it maybe expected to improve the creation efficiency because plentiful dataancillary to the program is essential in realizing data broadcastattractive to ultimate users.

(C) Subsidiary Information Data Creating System

As the subsidiary information data creating system, there may beenvisioned a system for primary inputting, which may be exclusively usedon the site of creation of content material, and a system for secondaryinputting, which may be used on the site of finishing the contentmaterial to the content on editing and processing.

Meanwhile, the former is used exclusively in a specialized terminal worksite, such as site of material collection, site of imaging or the siteof performance, where there is relatively little time allowance left fordata inputting. On the other hand, the latter is used on a site wherethere is relatively sufficient time allowance for data inputting, suchas a work site for affording secondary value to the created contentmaterial, such as broadcasting stations or video creating companies.This classification is, however, for the sake of convenience only and isnot to be construed in a limiting sense.

The picture program creating system which, through effective utilizationof the information created in the aforementioned sponsorship transactionsupport system, that is the sponsorship transaction related informationregistered in the membership database 21, allows for construction of amore efficient subsidiary information data creating system, ishereinafter explained.

(C-1) Subsidiary Information Data

(1) Basic Structure

FIG. 20 shows an example of the subsidiary information data.Specifically, FIG. 20 shows the relationship between the picture programdata 44 (content) and the subsidiary information data. The pictureprogram data 44 is comprised of program data (essence) 45, as main data,and data ancillary to the program (metadata) 46.

The program data 45 in the picture program is made up by video data 45Aand acoustic data 45B. In the case of a radio program, the program data45 is made up only of acoustic data. The data ancillary to the program46 is made up by general key data 46A, management data 46B, data forgoods and services 46C, layout information 46D and an index picture 46E.It is noted that the layout information 46D or the index picture 46E isnot essential but only optional.

The general key data 46A is a data area where the basic informationrelevant to program data itself is recorded. For example, UMID,meta-pocket ID (meta-mall ID), scene numbers, copyright, performers,positions and sites, inclusive of the GPS information, are recorded.

The UMID is an example of the code information that is able to uniquelyidentify the image material on the global range, for example, on thestation basis, on the keiretu basis and on the nation basis. Meanwhile,the information specifying the site may be exemplified by scene numbers,shot numbers, taking numbers and reel numbers. The meta-pocket ID givesan identification number of the meta-pocket corresponding to the scene.This information is generally accorded at the editing stage. Themeta-mall ID gives the identification number of the meta-mallcorresponding to the scene. This information is also accorded at theediting stage. Meanwhile, the information mainly specifying thephotopolymerization site is input.

The management data 46B is a data area where e.g., a broadcastingstation records the information necessary for managing video resources,such as date and time of real broadcast, program frame name, programname, contract registration date, term of validity, conditions and soforth. Among the conditions, there is a condition of use as‘commercial’.

The data for goods and services 46C is a data area in which to recordthe information relevant to commodities or services appearing in acorresponding scene, such as brand name, name of commodity category,name of commodities or services, name of sponsor business operator,contact site, URL, mail addresses, number of inventories, number oftimes of access events, term of delivery, price or the GPS information.

The above information is recorded as the necessity arises, such that notall items are always recorded. Basically, a series of the informationpertinent to each of the commodities or services is recorded. The datafor goods and services 46C are not necessarily limited to thesubject-matter of the sponsorship or to program furnishment. That is,the information can be recorded for all commodities and services. It isnoted that mainly the information for specifying the store where thegoods can be purchased or the store where the services can be furnishedis input as the GPS information.

The layout information 46D is the information for presenting the contentof the data ancillary to the program 46 to the audience, and is providedespecially for representation of meta-pocket or meta-mall. This layoutinformation 46D is sometimes as one with and inseparable from the datafor goods and services 46C. Here, the layout information is representedas being separable from the data for goods and services.

The index picture 46E is a picture for conveniently ascertaining thecontent of a corresponding scene of the data ancillary to the program.Usually, a representative frame picture (still picture) of acorresponding scene is recorded. It is noted that the index informationdoes not have to be the recorded video data but may be the linkinformation to the video data for a corresponding scene. In the dataarea, there may be recorded the link information for reproducing themoving picture data or acoustic data.

(2) Specified Example of Commodity or Service Data

FIG. 21 shows specified examples of the information recorded as the datafor goods and services. FIG. 21 shows only the goods and services feltto appear frequently. Of course, these goods and services are notlimitative.

In the picture programs for motion pictures, dramas or varieties (FIG.21A), the apparel, accessories, makes, hair styles, fittings, smallarticles etc., worn by the performer, are recorded. In a sports program(FIG. 21B), logos or other commercial marks for business entities,represented on sports equipment or advertisement plate or tower, sportsgoods etc. are recorded. In addition, as the information pertinent tomusic and video (FIG. 21C), the information pertinent to music numbers,such as theme songs, sound tracks or BGM, or the information relevant tovideo files cited in the programs, are recorded.

By recording the above information, as the data ancillary to theprogram, in association with the program data, expectations may beentertained of improving the commercial value of the program dataitself. That is, not only the picture program aimed to sell certainspecified goods (single goods or a set of goods) or services, orso-called television, but all other sorts of picture programs, can bedeemed as a platform that can be linked to the sale of the commoditiesor services.

Although this may be realized by an operation of inputting andoverseeing a large quantity of the information in a short time, markedreduction in the required labor and economic system management becomepossible by effective utilization of the information stored in theaforementioned sponsorship transaction support system. An illustrativestructure of a supplementary information data creating system, whichtakes into account the effective utilization of the informationaccumulated in the sponsorship transaction support system, ishereinafter explained.

(C-2) System for Primary Inputting

First, the primary inputting system, which assumes the work site ofcreating a video material and the initial inputting operation of thedata ancillary to the program, is explained. It is noted that theprimary and secondary systems are assumed only for convenience, that is,the primary system now explained may be used as the secondary system, orthe secondary system may be used as the primary system. Specifically, nolimitations are imposed as to the purposes of use of the respectivesystems.

(a) Terminal Structure

FIGS. 22 and 23 mainly show an embodiment used for a portable programancillary data creating device. FIG. 24 mainly shows an embodiment usedfor a standstill type program ancillary data creating device. Meanwhile,the difference between the program ancillary data creating device shownin FIGS. 22 and 23 and that shown in FIG. 24 is that the former capturesthe scene determining data directly from an imaging camera during theimage pickup operation, while the latter captures it from the reproducedpicture.

FIG. 22 showing the basic functional structure of the program ancillarydata creating device is first explained. A program ancillary datacreating device 50 includes a display controller 50A, an inputting formrecording unit 50B, an input data recording unit 20C, a generating unitfor generating data ancillary to the program 50D, a recording unit forrecording data ancillary to the program 50E, a controller 50F, a codeinformation receiving unit 50G, a scene recording unit 50H, a selectioninput information recording unit 50I, a bus 50J, an operating input unit50K and display means 50L.

In FIG. 22, the operating input unit 50K and the display means 50L areshown connected to outside the main body unit of the device.Alternatively, the operating input unit and the display means may beunified with the main body unit of the device, as in the case of thenotebook personal computer, PDA or a portable telephone set.Additionally, the recording and code communication units, shown enclosedin the main body unit, may be connected externally of the main bodyunit. For external connection, cable connection or radio connection maybe used. For cable connection, serial connection or parallel connectionmay be used, while coaxial cables, twisted pair cables or optical fibersmay be used. For radio connection, there is no particular limitation tothe radio frequency range, while the spread spectrum system, such asBluetooth, may or may not be used.

The display controller 50A is means for reproducing and outputting videodata in signal forms (data forms) conforming to the display means 50L.Output signals may, for example, be a video output (NTSC video,composite video and S-video) or RGB output. The display controller 50Aincludes a data decoding function, such as one provided by MPEG (MovingPicture Experts Group), depending on the purposes of use.

The inputting form recording unit 50B is a recording or storage mediumfor storing an input form for data ancillary to the program. It is notedthat the medium does not have to be used solely for storage of the inputform of the data ancillary to the program, but may be used for recordingor storing other information in combination. The medium may, forexample, be a CD-ROM, a magnetic recording type medium, such as tape,floppy disc, hard disc or a magnetic card, an optical recording medium,such as write-once CD, DVD or optical card, magneto-optical recordingtype medium, such as DVD, MD or MO, and semiconductor memory, such asnon-volatile memory or RAM.

The inputting form recorded will be explained later in detail. Theregistration form may be pre-fixed on the medium, duplicated from otherrecording mediums or downloaded over a communication network, such asInternet. The registration form may be expanded on a video RAM providedin e.g., the display controller 50A.

The input data recording unit 50C is a recording or storage medium forrecording data input via operating input unit 50K. By and large, a RAMis used as this medium. However, there is no limitation to the sort ofthe medium provided that the medium used is one on which it is possibleto write input data. On the other hand, it is not mandatory for thisinput data recording unit 50C to be a recording unit dedicated torecording the input data. For example, the input data recording unit 50Cmay be realized by a medium which is the same medium as the inputtingform recording unit 50B, with the recording area then being a distinctarea. The inputting form recording unit 50B or the input data recordingunit 50C may be provided within the inside of the display controller50A.

The generating unit 50D for generating data ancillary to the program ismeans for linking the input data recorded in the input data recordingunit 50C and the code information recorded in the scene recording unit50H, such as UMID or time codes as the scene information recorded in thescene recording unit 50H, to generate data ancillary to the program. Itis however possible to cause the program ancillary data generating unit50D to generate data ancillary to the program 46 shown in FIG. 20. Itmay however be presumed that the generating unit 50D for generating dataancillary to the program for a site of imaging placed under temporalconstraint or a similar creating site has as an object of creation tocreate the program ancillary data consisting only of the limitedinformation such as the information specifying the scene or the companyfurnishing commodities or services.

The recording unit 50E for recording data ancillary to the program is arecording or storage medium for recording the created program ancillarydata. The medium may be exemplified by a CD-ROM, a magnetic recordingtype medium, such as tape, floppy disc, hard disc or a magnetic card, anoptical recording medium, such as write-once CD, DVD or an optical card,a magneto-optical recording type medium, such as DVD, MD or MO, and asemiconductor memory, such as non-volatile memory or RAM.

If the program ancillary data recorded is to be transmitted to otherdevices, such as, for example, a device for processing or editing thedata ancillary to the program, over a communication system, which may bewired or wireless, it is sufficient if communication means having thecommunication function for the program ancillary data is provided in theprogram ancillary data generating unit. It is noted that thecommunication function complying with the transmission medium isrequired of this communication means. When a medium separable from themain body unit of the device is used for a recording medium or a storagemedium, such as DVD or non-volatile memory, the medium can be taken outfrom the main body unit of the device and transferred to another device.

The controller 50F is means for executing variegated control or signalprocessing of various component parts making up the generating device 50for data ancillary to the program, and is routinely of themicro-computer configuration. The functions of the controller 50F isusually prescribed by an operation system program and by an applicationprogram.

The code information receiving unit 50G is means for receiving the scenespecifying information, such as UMID or time codes, of program datanotified in real-time from an imaging camera 51 in the course of theimaging operation. The functions required of the code informationreceiving unit 50G are those conforming to the transmission systembetween the imaging camera 51 and the main body unit of the device.Although the communication system shown in FIG. 22 is a wireless system,it is of course not contemplated to exclude the wired communicationsystem. It should be noted that the wireless system is more convenientsince there is imposed no constraint as to inputting positions, and alsosince there is no necessity of providing a wired cable.

It is also possible to provide means for detecting a scene change point(a scene change extraction unit) in the code information receiving unitso that the new code information will be automatically recorded in thescene recording unit 50H every time a scene change point is detected.Meanwhile, if the scene specifying information is UMID, one code isassociated with one scene, so that the scene change point may bedetected by monitoring the scene change point of the code information.

The scene recording unit 50H is a recording or storage medium forwriting the code information, being captured by the code informationreceiving unit 50G, based on the scene information capturing signalaccorded by the operating input unit 50K at the time of inputting thesignal. The medium may be exemplified by a CD-ROM, a magnetic recordingtype medium, such as tape, floppy disc, hard disc or a magnetic card, anoptical recording medium, such as write-once CD, DVD or optical card,magneto-optical recording type medium, such as DVD, MD or MO, andsemiconductor memory, such as non-volatile memory or RAM. It is ofcourse possible to use the physically same medium as the other recordingunit, with only the recording area being then different from that usedby the other recording unit.

The selection input information recording unit 50I represents thefunction provided when a selective input function is readied forinputting the data ancillary to the program. So, this recording unit isunnecessary when all the inputting operations are executed manually. Theinformation recorded in the recording unit may be the informationrecorded in advance by an operator of the generating device 50 for dataancillary to the program, or the information pertinent to thecommodities or services procured from the aforementioned sponsorshiptransaction support system or the database system. As methods forprocuring the information from the sponsorship transaction supportsystem or the database system, a method of having the data furnished bycommunication and a method of having the data furnished by a medium canbe used. If the communication is used, it may be wired or wireless.

The information at issue may be the totality of the informationregistered in connection with the commodities or services. When thenumber of the items of selection is excessive, the operating efficiencymay occasionally be lowered. Consequently, when the use on the site ispresupposed, it is possibly desirable to limit the information to thename of the company furnishing the commodities or services or to thecommon names of the commodities or services furnished. It is noted that,except in case the information is input in parallel with the imagingoperations, selection may be made up to more detailed information, bymaking contrivances in retrieving characteristics of the selectionitems, so that, in such case, such information may be recorded which isin meeting with the purposes of use in question.

The medium may be exemplified by a CD-ROM, a magnetic recording typemedium, such as tape, floppy disc, hard disc or a magnetic card, anoptical recording medium, such as write-once CD, DVD or optical card, amagneto-optical recording type medium, such as DVD, MD or MO, and asemiconductor memory, such as non-volatile memory or RAM. It is ofcourse possible to use the physically same medium as the other recordingunit with only the recording area being then different from that used bythe other recording unit. If the information is furnished in the form ofa medium, it may be contemplated to use a CD-ROM or a non-volatilememory.

The bus 50J is a data input/output bus, which may, for example, be anISA bus, an EISA bus or a PCI bus. The operating input unit 50K may, forexample, be a keyboard, a mouse, a pointing device, such as pad, pen orpointer, a dial, having or not having a click function, and a pushbuttonkey.

The display means 50L is a device used for demonstrating a picture, suchas an input screens for data ancillary to the program. In the case of aportable device, a small-sized lightweight display device, such as aliquid crystal device, may be used. When the display means 50L is usedas a standstill type device, a monitor device or a television receivermay, of course, be used.

The imaging camera 51 may be made up by a camera by itself, or a camerafitted with a recorder (so-called camera built-in type recorder). It mayalso be an electronic camera for photographing a still picture.Meanwhile, the generic key data pertinent to imaging is recorded on apreset recording medium along with program data.

Reference is now made to FIG. 23 showing a further input assistingfunction to the program ancillary data generating device in FIG. 23.Since the parts corresponding to those shown in FIG. 22 are indicatedwith the same reference numerals as in FIG. 22, only differentfunctional portions are explained. The added portions are four units,that is a sponsor information decision unit 50M, a recording unit forsponsorship commodities or services 50N, a flag imparting unit 50O and acheck imparting unit 50P.

The sponsor information decision unit 50M is means for verifying whetheror not there is any portion in the information recorded in the recordingunit for sponsorship commodities or services 50N which coincides withthe input information on the commodities or services. This function isparticularly effective when the information on specified commodities orservices is input. Meanwhile, the function of the decision unit isroutinely implemented as one of application programs executed by thecontroller 50F.

The recording unit for sponsorship commodities or services 50N is arecording or storage medium which includes the recording information fordecision by the sponsor information decision unit 50M. This medium maybe exemplified by CD-ROM, a magnetic recording type medium, such astape, floppy disc, hard disc or a magnetic card, an optical recordingmedium, such as write-once CD, DVD or an optical card, a magneto-opticalrecording type medium, such as DVD, MD or MO, and a semiconductormemory, such as non-volatile memory or RAM. It is of course possible touse the physically same medium as the other recording unit with only therecording area being then different from that used by the otherrecording unit. Consequently, the same medium may be used for thisrecording unit for sponsorship commodities or services and for e.g., theselection input information recording unit 50I. Since this informationis the information on the sponsorship-related commodities or services,agreed to as to the creation of a picture program, the relevantinformation accumulated in the above-mentioned sponsorship transactionsupport system, if any, may be used for realizing effective informationutilization. However, when the sponsorship transaction support system isnot used, the information separately input may be used.

The flag imparting unit 50O is means for imparting to the programancillary data flag data indicating that the input information has beenfound by the sponsor information decision unit 50M to be thesponsorship-related commodities or services. Specifically, the flagimparting unit is means for setting the data portion, procured fordisplaying whether or not the commodities or services in question arethose pertinent to the accepted sponsorship, to a significant level(imparting a flag). By recording the information in question in the dataancillary to the program, signal processing of preparing a pictureconsisting only of a collection of the sponsorship-related informationbecomes feasible.

The check imparting unit 50P is means for causing the same informationas the flag imparting unit 50O to be reflected in the display picture.That is, the check imparting unit 50P is means for automaticallyimparting check marks to check item columns on the display picture if,as a result of the decision by the sponsor information decision unit50M, the input information corresponds to the sponsorship-relatedcommodities or services. It is of course presupposed that there is adisplay column in the input item that is used for indicating whether ornot the information in question is pertinent to the sponsorship. It ishowever also possible that the information is manually input by no otherthan the operator. This function, if provided, is helpful to improve theinputting efficiency and to evade mistaken inputs.

Meanwhile, the flag imparting unit 50O and the check imparting unit 50Pare each implemented as one of the application programs executed by thecontroller 50F. These functions are loaded as one set in conjunctionwith the sponsor information decision unit 50M. While these functionsare usually loaded on both units, it may also be loaded on one of theunits.

Reference is made to FIG. 24 showing an illustrative structure of agenerating device for data ancillary to the program, adapted foracquiring the scene information, for which the data ancillary to theprogram is to be prepared, from the general key data reproduced from therecording medium. Similarly to FIG. 22, FIG. 24 shows only the basicfunctional portions. It is therefore possible to load the sponsorinformation decision unit 50M, a recording unit for sponsorshipcommodities or services 50N, a flag imparting unit 50O and a checkimparting unit 50P shown in FIG. 23.

The points of difference of the program ancillary data generating deviceof FIG. 24 from the device shown in FIG. 22 reside in the substitutionof a code information extraction unit 50Q for the code informationreceiving unit 50G, and in a picture program data reproducing device 50Rbeing shown in the drawing.

The code information extraction unit 50Q is means for perpetuallymonitoring replay signals of the picture program data reproducing device50R for extracting the scene specifying information, such as UMID ortime codes. Meanwhile, in the case of the generating device forgenerating the data ancillary to the program, shown in FIG. 24, a replaypicture needs to be displayed on the picture of the display means 50 oron the picture of other monitor devices. An operator who intends toprepare data ancillary to the program executes the operation of sceneselection at such a scene as is suited to the creation of the programancillary data pertinent to the commodities or services as the operatorconfirms the picture being reproduced on a display picture in questionoccasionally with speech or other sound. It is possible to provide ascene change extraction unit in the code information extraction unit 50Qso that the new code information can be automatically recorded in thescene recording unit 50H each time a scene change point is detected.

The picture program data reproducing device 50R is a device forreproducing picture program data recorded on a medium exemplified by aCD-ROM, a magnetic recording type medium, such as tape, floppy disc,hard disc or a magnetic card, an optical recording medium, such aswrite-once CD, DVD or optical card, magneto-optical recording typemedium, such as DVD, MD or MO, and a semiconductor memory, such asnon-volatile memory or RAM, and includes a variable reproducing signalsystem loaded thereon, depending on the types of the mediums or on therecording formats.

It is noted that the picture program data reproducing device 50R neednot be a replay-only device but may have loaded thereon a recordingsystem adapted for recording picture program data supplied from theimaging camera 51 on a preset medium in accordance with a preset format.Although the picture program data reproducing device 50R is shown inFIG. 24 to be provided within the casing of the generating device 50 forprogram ancillary data, it may, of course, be mounted outside of themain body unit of the device. In this case, the main body unit of thedevice needs to be provided with a function of communication with thepicture program data reproducing device 50R. Meanwhile, if the pictureprogram data reproducing device 50R is provided outside of the main bodyunit of the device, the generating device for program ancillary data 50may readily be designed as a portable device.

The generating device 50 for program ancillary data, shown in FIGS. 22to 24, may be formed by computer terminals, such as notebook or desktoppersonal computers, PDA, portable telephone sets, game machines, set topboxes, PC cards, domestic electrical utensils, VTR, televisionreceivers, car navigation systems, wrist watches having the informationprocessing functions, distribution terminals for music or games,financial terminals (ATM) etc., in addition to the so-called dedicatedterminals.

(b) Input Form Picture

FIGS. 25 to 27 show examples of input form pictures. These input formsare suited to a work site where especially the inputting time availableis limited. By employing these input forms, input items can be unifiedno matter who is performing the inputting operations. In particular,since a large number of staff members and program creating companies areinvolved in the creation of a picture program, there is a significantmerit of unification of input items in overseeing picture resources. Bypositively exploiting these properties, it is possible to distribute theinputting operations among plural operators to realize efficientinputting.

FIG. 25 shows a first instance of the input picture. In the case of FIG.25, an information inputting column 54 and an already input informationdisplay column 55 are displayed in an upper row and in a mid row of adisplay picture 53, respectively, while a decision button 56, acorrection button 57, a scene inputting button 58 and a sponsor button59 are displayed in a lower row. Since a manual operation of inputtingthe scene is here presupposed, the scene inputting button 58 isindicated. Additionally, since here a manual operation of inputting thetenor that the goods or services are those pertinent to the sponsorshipas furnished by the sponsor business operator is presupposed, there isalso provided the sponsor button 59.

In the information inputting column 54, there are displayed input items54A to 54C and associated input columns 54D to 54F. In the case of FIG.25, the input items are a scene information 54A, a time code 54B and acompany name 54C. Meanwhile, the company name is that of a company whichmanufactured or supplied the commodities or services appearing in thepictures of respective scenes.

In the input columns 54D and 54E, among the input columns 54D to 54F,which are associated with the scene information 54A and the time code54B, respectively, the code information which is valid at the time pointof operation of the scene inputting button 58 is automaticallydisplayed. It is noted that, in automatically inputting the sceneinformation or the time code, the code information is displayedautomatically. Consequently, the item in need of manual inputting by anoperator in the present exemplary picture is solely the company name54C. Meanwhile, the information as to whether or not the information isthe information concerning the commodities or services pertinent to thesponsor is input by acting on the sponsor button 59. Although thesetting of FIG. 25 is made so that the information indicating whether ornot the input object is the commodities or services pertinent to thesponsor is not displayed in the information inputting column 54, thisinformation may, if desired, be displayed.

As means for manually inputting the information in the informationinputting column 54, an input key, not shown, with a letter allocatedthereto, a dial key or a keyboard etc., is used. A pen inputtingfunction may also be used. For finally determining the contents enteredinto the information inputting column 54, the decision button 56 isused. The information, input finally, is displayed in the already inputinformation display column 55.

In the already input information display column 55, a scroll bar 55A anda title bar 55B are demonstrated in addition to the already inputinformation. In the title bar 55B, items associated with input items ofthe information inputting column 54 are normally displayed. In the caseof FIG. 25, an item not indicated in the information inputting column54, that is the ‘sponsorship-related goods’, is displayed in the titlebar 55B, for the sake of confirmation of the information input byoperation of the sponsor button 59. Alternatively, the information as towhether or not the goods (or services) are the sponsorship-relatedcommodities or services can be adapted to be entered on the displaypicture of the already input information display column 55. Forinputting the information, such methods may be contemplated whichconsist in operating the sponsor button 59 as the check column isdesignated, or which consist in touching the check column with an inputpen, for example, a method consisting in detecting the position of a penpoint by position detection means comprised of a transparent electrodewhich covers up the display picture. The items checked are changed indisplay so that the items so checked can be discriminated from otherunchecked items. In FIG. 25, the check column is displayed as if it ispainted as indicated at 55C.

The correction button 57 is used for correcting the input information.For example, the correction button 57 is operated as an input letterstring desired to be corrected is designated. By acting on thecorrection button 57, the information to be corrected is againdemonstrated in the information inputting column 54 in readiness forcorrection.

If desired to register plural company names for one scene, the decisionbutton 56 may be depressed, as a button having an allocated function ofinputting plural company names, in order to save the scene information54D and a time code 54E. Alternatively, there may be providedduplication buttons for the scene specifying information (sceneinformation and time code in the case of FIG. 25) for duplicating thescene specifying information of the input information selected on thedisplay picture of the already input information display column 55 inthe input columns 54D and 54E. If there is provided a function ofautomatically updating the scene specifying information of the inputcolumn, it is possible not to update the information of the inputcolumns 54D, 54E until such time when an operator performs a specifiedoperation.

FIG. 26 shows a second exemplary input picture. The exemplary display,shown in FIG. 26, shows a case wherein the selection input informationrecording unit 50I is loaded in the device 50 for generating programancillary data. In FIG. 26, the function of selective inputting isallocated to the input column 54F for the input item ‘company name’. InFIG. 26, there is shown the state in which a selective candidate picture54G for the input column 54F is shown deployed. In the case of suchinput picture, it is sufficient if the inputting operator selects one ofthe items shown in a list in a selection candidate picture 54G.

In FIG. 27, show in a third exemplary input picture, a drag-and-dropsystem is used for inputting the information, in distinction from theaforementioned two exemplary input pictures. So, in this third exemplarypicture, there is adopted a system of displaying input candidates in alist in a selection item display column 60. In the case of FIG. 27, acandidate button 60C, having the input candidate information allocatedthereto, is displayed. The present exemplary input picture is the sameas the aforementioned exemplary input picture in that a scroll bar 61Aand a title bar 61B are displayed in the information inputting column60. The present exemplary input picture is also the same as theaforementioned exemplary input picture in that the scroll bar 60A andthe title bar 60B are demonstrated in the information inputting item 60.

Moreover, in this third exemplary input picture, the already inputinformation display column 61, operating not only as a column forconfirming the already input information but also as a column forinputting the novel information, is indicated below the informationinputting column 60. It is noted that the scroll bar 61A and the titlebar 61B are displayed in the already input information display column 61as in the above-described exemplary input picture. The display of itemsof the check column of the goods pertinent to sponsor (or servicespertinent to sponsor) are changed as indicated at 61C, as in theabove-described exemplary input picture.

In the case of FIG. 27, the inputting of the company names of thecommodities or services is by drag-and drop of the selected candidatebutton 60C at a display position of the scene specifying information(scene information and time code) as captured by the operation on thescene inputting button 58 or by the automatic scene change detection.Instead of by drag-and drop, the information may be input by acting onthe decision button 56 as e.g., a certain one of buttons of thecandidate buttons 60C remains selected.

In the aforementioned three exemplary input pictures, it is presupposedthat the site information, such as UMID, or the time code, such as hour:minute: second: frame number, are automatically input. Alternatively,these information may also be input manually. Still alternatively, oneof the scene information and the time code may be input. The same may besaid of display.

(c) Processing Operations at the Time of Inputting Operations

FIGS. 28 and 29 show an exemplary processing sequence at the time ofinputting by the generating device 50 for program ancillary data. FIG.28 is relevant to the generating device 50 for program ancillary datahaving the selective inputting function, while FIG. 29 is relevant tothe generating device 50 for program ancillary data having thedrag-and-drip function. It should be noted that, in both FIGS. 28 and29, there is loaded the function of automatically affording check marksin the check item columns of the display picture in case the inputinformation corresponds to the sponsorship-related commodities orservices.

Referring first to FIG. 28, when commanded to execute the applicationprogram for executing the function in question, the controller 50F readsout an inputting form from the inputting form recording unit 50B (stepS21). The controller 50F deploys the input form, thus read out, on thedisplay controller 50A, to output the input form in a preset signal form(data format) to the display means 50L. This demonstrates the input formshown for example in FIG. 26 (step S22).

At this display picture, the controller 50F verifies whether or not theoperation of selecting an input scene has been carried out (step S23).This selective operation is carried out through the scene inputtingbutton 58. If the selection of the scene through the operation of thescene inputting button 58 has been confirmed, that is if the result atstep S23 is affirmative, the controller 50F records the codeinformation, captured at the time point in question, in the scenerecording unit 50H. For example, the code information capturing path maybe through the code information receiving unit 50G (FIGS. 22 and 23) orthrough the code information extraction unit 50Q (FIG. 24). Thecontroller 50F then imparts the captured information to the displaycontroller 50A to display the information in relation to the input formbeing displayed.

The controller 50F then verifies whether or not the input item asspecified is an item that can be selectively input. A negative resultand an affirmative result are obtained when an item directly input by anoperator (an item where an optional letter string is input), such as‘company name’ of FIG. 25, is specified, and when an item directlyentered by the operator, such as [company's name] of FIG. 26, isspecified, respectively.

In case the affirmative result is obtained, the controller 50F reads outthe information previously provided as to a relevant item, that is theinformation recorded in the selection input information recording unit50I, to impart the information so read out to the display controller 50Ato make a list display of input candidates, as shown in FIG. 26 (stepS26). If a candidate is selected in this state, that is when an item isselected by a cursor shifting key, not shown, and the decision button 56is depressed, the controller 50F displays the information so decided onin the input column 54F (step S27). If the negative result is obtained,the controller 50F causes the information input by the operator as tothe relevant item to be displayed in the input column 54F.

When the input item is finally determined in this manner, the controller50F causes the sponsor information decision unit 50M to check whether ornot the input information is relevant to the commodities or servicespertinent to the sponsor (step S29). If the input information isverified to be the commodities or services pertinent to the sponsor,that is if the affirmative result is obtained at step S29, the checkimparting unit 50P issues a command to the display controller 50A toimpart a check mark. Thus, the check mark, such as 55C, is displayed inthe check item column to complete the input processing for one commodityor service (step S30).

When a decision is given that the input information is not thesponsorship-related commodities or services, that is if the negativeresult is obtained at step S29, no command is issued from the checkimparting unit 50P to the display controller 50A, or a command is issuedfrom the check imparting unit to the display controller that no checkmark is to be displayed. As a result, the inputting processing for onecommodity or service is completed, there being no change made in thedisplay picture.

For finally determining the termination of the input processing, anoperation by the decision button 56 may be made a necessary step. InFIG. 28, it is assumed that the generating device for data ancillary tothe program has the function of automatically verifying the commoditiesor services relevant to the sponsorship and the function ofautomatically imparting the check mark. However, since the automaticcheck as to whether or not the commodities or services in question arethose relevant to the sponsorship has no significant meaning if theinput is on the company level, it may be contemplated to make the checkof the check columns of the items of the sponsor goods by manualoperations.

Referring to FIG. 29, when commanded to execute the application programfor function execution, the inputting form recording unit 50B of thecontroller 50F deploys the read-out input form on the display controller50A to output the input form in a preset signal or data format to thedisplay means 50L. So, the input form shown for example in FIG. 27 isdisplayed (step S32).

In this display picture, the controller 50F checks to see whether or notthe input picture selecting operation has been carried out (step S33).This selecting operation is carried out through the scene inputtingbutton 58. When the scene selection through the operation of the sceneinputting button 58 is recognized, that is if the affirmative result isobtained at step S33, the controller 50F causes the code information,captured at the time point in question, to be recorded in the scenerecording unit 50H. The code information capturing route is the same asthat explained in FIG. 28. The controller 50F then sends the capturedinformation to the display controller 50A to display the information inassociation with the input form being demonstrated.

The controller 50F monitors which of the items demonstrated on theselection item display column 60 has been selected by the operator andwhich area is the destination of drag-and-drop of the selectedinformation. If the destination of drag-and-drop is a preset position inthe already input information display column 61, the controller causesthe selected information to be demonstrated at such position. The dropdestination may be limited to a display string in which the scenespecifying information of the information currently being input isdisplayed, or may simply be any arbitrary position in the already inputinformation display column.

The ensuing processing is the same as that of FIG. 28, as may be seenfrom the same reference numerals used as those in FIG. 28, and hence isnot explained specifically.

(C-3) Secondary Inputting System

The secondary inputting system, which presupposes the post-inputtingoperation of the data ancillary to the program or the editing work siteof the picture material, is hereinafter explained. As aforesaid, thedivision into the primary and the secondary is for convenience only suchthat the secondary inputting system may also be used as the primaryinputting system. Meanwhile, it is not mandatory that the system isprovided on the picture creating business operator, such that it may beprovided on the brokerage business operator acting as an intermediary inthe commercial transaction between the audience and the sponsor businessoperator.

(a) Terminal Structure

FIGS. 30 and 31 show an embodiment of the program ancillary datacreating device and FIG. 32 shows an embodiment of a picture programediting device provided with the program ancillary data creating device.The ultimate outputting of the program ancillary data creating device isclassified into the transmission path output type and the recordingoutput type. These respective cases are hereinafter explained.

Reference is first made to FIGS. 30 and 31. A creating device forprogram ancillary data 63, shown in FIG. 30, includes a displaycontroller 63A, an input data recording unit 63B, a recording unit forprogram ancillary data 63C, a controller 63D, a data creating unit forprogram ancillary data 63E, an index picture recording unit 63F, anindex picture creating unit 63G, a layout information holding unit 63H,a link information embedding functional unit 63I, an interface 63J, abus 63K, an operating input unit 63L and display means 63M.

Although the operating input unit 63L and the display means 63M areshown in FIG. 30 to be connected externally to the main body unit of thedevice, the operating inputting unit and the display means may also beconnected as one to the main body unit of the device, as in the case ofa notebook personal computer, a PDA and a portable telephone set.Although the recording unit and the various functional units are shownenclosed in the main body unit, these may also be connected to outsidethe main body unit. For external connection, cable connection or radioconnection may be used. In the case of the cable connection, serial orparallel connection may be used, while coaxial cables, twisted paircables or optical fibers may also be used. As for radio connection,there is no particular limitation to the radio frequency range used,while the spread spectrum system, such as Bluetooth, may or may not beused.

The display controller 63A is means for reproducing and outputtingpicture data in signals forms (data forms) conforming to the displaymeans 63M. Output signals may, for example, be a video output (NTSCvideo, composite video and S-video) or an RGB output. The displaycontroller includes a data decoding function, such as one provided byMPEG (Moving Picture Experts Group), depending on the purposes of use.

The input data recording unit 63B is a recording or storage medium forrecording data input through the operating input unit 63L. While themedium routinely employed is a RAM, there is no limitation to the typeof the recording medium provided that it permits writing of input data.There is no necessity for the input data recording unit 63B to be arecording unit dedicated to the recording of the input data. It is ofcourse possible to use the physically same medium for the input datarecording unit 63B as the recording unit for program ancillary data 63C,if only the recording area is different from that used by the otherrecording unit. Meanwhile, the input data recording unit 63B and therecording unit for program ancillary data 63C may be provided within thedisplay controller 63A.

The picture program data recording device 63C is a device for recordingprogram ancillary data created and may be exemplified by a magneticrecording type medium, such as tape, floppy disc, hard disc or amagnetic card, an optical recording medium, such as write-once CD, DVDor an optical card, a magneto-optical recording type medium, such asDVD, MD or MO, and a semiconductor memory, such as non-volatile memoryor RAM

The controller 63D is means for executing variegated control or signalprocessing of various component parts making up the generating device 63for program ancillary data. This controller is routinely of themicro-computer configuration. The functions of the controller 63D areusually prescribed by an operation system program and by an applicationprogram.

The data creating unit for program ancillary data 63E is means forlinking input data recorded in the input data recording unit 50C and thelayout information recorded in the layout information holding unit 63H(layout information used in presentation for the audience) and otherinformation to generate program ancillary data. In this data creatingunit 63E for program ancillary data, the program ancillary data 46,shown in FIG. 20, is produced.

The index data recording unit 63F is a recording or storage medium forrecording an index picture used in confirming a picture program sceneassociated with the program ancillary data. While the medium routinelyemployed is a RAM, there is no limitation to the type of the recordingmedium provided that it permits writing of input data. There is nonecessity for the index data recording unit 63F to be a recording unitdedicated to the recording of the index data. It is of course possibleto use the physically same medium for the index data recording unit 63Fas the program ancillary data recording unit 63C, with only therecording area being then different from that used by the programancillary data.

The index picture creating unit 63G is means for extracting a typicalframe picture of a scene corresponding to the program ancillary data asan index picture. Since the index picture is used for confirming thecorresponding scene, the picture information reduced in picture qualityas compared to the picture used in the actual broadcast is produced. Itis, however, not mandatory to degrade the picture quality, such that thesame information may be included in the index picture as that of theactual broadcast.

For the index picture, such a frame picture representative of thecontent of each scene is used. For example, a leading frame of acorresponding scene, a frame which allows for facilitated confirmationof the commodities or services pertinent to the sponsorship, as selectedby the operator, or a trailing end frame of the corresponding scene, maybe used as the index frame. If the rule for selecting the frame pictureis set in this manner, it is possible for the index picture creatingunit 63G to create the index picture automatically. However, dependingon the selection by the operator, a frame picture of the time code ascommanded by the operating input unit 63K may be used. The index picturemay also be represented by computer graphics.

The layout information holding unit 63H is a recording or storage mediumfor holding the layout information used for prescribing the modifyinginformation or the display position for the program ancillary data forfacilitating the confirmation by the audience of the program ancillarydata. These mediums may be exemplified by a magnetic recording typemedium, such as tape, floppy disc, hard disc or a magnetic card, anoptical recording medium, such as write-once CD, DVD or an optical card,a magneto-optical recording type medium, such as DVD, MD or MO, and asemiconductor memory, such as non-volatile memory or RAM. It is ofcourse possible to use the physically same medium as the other recordingunit, with only the recording area being then different from that usedby the other recording unit.

The layout information may be exemplified by e.g., a style sheet of anXML (Extensible Markup language) file. In universality is taken intoaccount, such layout information that can be handled independently ofe.g., the detailed information pertinent to commodities or services isdesirable. Of course, the demonstration of the program ancillary data bythe HTML (Hypertext Markup Language) is not excluded. Which language isto be used for indicating the program ancillary data is determined onthe basis of a route through which the information is furnished.

As for the layout information, which will be explained in detailsubsequently, it may be contemplated to provide solely the informationpertinent to one commodity or service with a sole information furnishingpicture, to enable the presentation of the information pertinent toplural commodities or services appearing in a sole scene by the soleinformation furnishing picture (as in the case of the aforementionedmeta-pocket), or to enable the presentation of the information pertinentto plural commodities or services appearing in plural scenes, each ofwhich is associated with the information pertinent to the pluralcommodities or services, by the sole information furnishing picture (asin the case of the aforementioned meta-mall).

The link information embedding functional unit 63I is means forembedding the link information used for linking the moving picturereproducing function of picture data or the reproducing function ofacoustic data of a scene associated with the index picture in case theindex picture is embedded in the program ancillary data. For example,there is recorded the link information to the file information ofprogram data (picture data or acoustic data) having the scene specifyinginformation of the corresponding scene, such as UMID or time code, orthe link information to the file information separately provided for thereproducing function of the moving picture or that of the acoustic data.Meanwhile, the data separately provided for the functions of reproducingthe moving picture or the acoustic data may be data edited forsimplified presentation or data for a partial scene period.

The interface 63J is interfacing means with respect to a local areanetwork (LAN) 70. Although a bus type LAN is used in FIG. 30, severalmethods for connection may be envisaged, such as ring connection or starconnection.

The bus 63K is a data input/output bus, exemplified by an ISA bus, EISAbus or PCI bus. The operating input unit 63L may be exemplified by akeyboard, a mouse, a pointing device, such as pad, pen or pointer, adial, having or not having a click function, and a pushbutton key.

The display means 63M is a device used for demonstrating a picture, suchas an input picture for the program ancillary data. A monitor device isroutinely employed. For household use, a picture of a televisionreceiver is used. In the case of a portable device, a small-sizedlightweight type display device, such as a liquid crystal displaydevice, is used.

The program ancillary data generating device 63, shown in FIG. 30, maybe formed by computer terminals, such as notebook or desktop personalcomputers, PDA, portable telephone sets, game machines, set top boxes,PC cards, domestic electrical utensils, VTR, television receivers, carnavigation systems, wrist watches having the information processingfunctions, distribution terminals for music or games, financialterminals (ATM) etc., in addition to the so-called dedicated terminals.

When the data creating device for program ancillary data 63 is used in abroadcasting station or a picture creating company, a database forprogram ancillary data 65, a database for commodities or services 66, aprogram data reproducing device 67, a device for creating data fortransmission 68 and a multiplexing processing device 69 are connected tothe data creating device for program ancillary data 63 over LAN 70.

The database for program ancillary data 65 is used not only forcapturing and storing the program ancillary data created in the primaryinputting system, but also for storing the program ancillary datacreated anew in the aforementioned data creating device for programancillary data 63. For capturing data from the primary inputting system,an interfacing equipment, not shown, is used. The program ancillary datais captured in the form of data transmission or of a recording medium.There is no limitation to the transmission system or to the recordingmedium configuration.

The database for commodities or services 66 is used for storing thedetailed information pertinent to the commodities or services necessaryfor creating the program ancillary data. The information stored may beinput separately by the secondary inputting system or acquired from theaforementioned sponsorship transaction support system. If acquired fromthe sponsorship transaction support system, the sequence of theinformation is captured in the configuration of transmission or therecording medium. There is no limitation to the transmission system orto the recording medium configuration.

The program data reproducing device 67 is means for reproducing theedited program data. As this reproducing means, such device that is inkeeping with the medium having recorded the program data is used. If,for example, the program data is recorded on a magnetic tape, a videotape recorder (VTR) is used, whereas, if the program data is recorded ona hard disc, a hard disc driving device is used. Of course, when theprogram data is recorded on an optical medium, an optical reproducingdevice is used. Meanwhile, the program data reproduced by the programdata reproducing device 67, such as picture data or audio data, is usednot only in the data creating device for program ancillary data 63 butalso for actual broadcast to the audience.

The device for creating data for transmission 68 is means for convertingthe program ancillary data into the data format matched to theoutputting configuration for outputting the program ancillary data alongwith the picture data. An illustrative structure of the device forcreating data for transmission 68 is shown in FIG. 31. In the case ofFIG. 31, the device for creating data for transmission 68 is made up bya LAN interface 68A, a packet processing unit 68B for converting theprogram ancillary data into packet data, a communication unit 68C forcontrol with outside, an access information acquisition unit 68D, anumber of times of access imparting unit 68E and a bus 68F.

In FIG. 31, the program ancillary data is converted into packets of adata structure which is in meeting with the transmission format, usingthe packet processing unit 68B. Alternatively, the program ancillarydata can be transmitted in the file transmission system. The accessinformation acquisition unit 68D is means for acquiring the accessinformation, as an index for the interest the audience has in thecommodities or services pertinent to each program ancillary data, fromthe database of the transaction brokerage business operator. Foracquiring the information, the communication unit 68C is used. Acommunication unit which is in keeping with the communication network,used for connection to the external database, is used for thecommunication unit 68C. The communication may be made over a wired pathor over a wireless path, without any limitations.

The number of times of access imparting unit 68E is means for accordingthe results of sum of the number of times of access, on the commodity orservice basis or on the scene basis, to the program ancillary data. Byproviding such function in the device for creating data for transmission68, the program ancillary data having the latest access informationappended thereto may at all times be distributed in the broadcast orcommunication configuration. The processing of summing the number oftimes of access events can be executed within the device for creatingdata for transmission 68 or may be directly received from the externaldatabase.

This device for creating data for transmission 68 forms a pictureprogram data creating device 73 in conjunction with a multiplexingdevice 69, as later explained. Meanwhile, the multiplexing device 69 ismeans for multiplexing the program ancillary data, packetized in thedevice for creating data for transmission 68, into program data(packetized program data) supplied from the program data reproducingdevice 67. By this multiplexing processing, picture program data of theultimate output configuration is generated.

Meanwhile, a gateway 71 is hardware or software means forinterconnecting the Internet or the wireless communication network withthe LAN 70. The system of FIG. 30 is used solely for transmitting thepicture program data (output of the multiplexing device 69 or theprogram data for transmitting only the program ancillary data. By andlarge, the transmission occurs in the transmission or communicationconfiguration.

A recording device 72 is means for recording picture program data on arecording medium for distribution to the consumer. Such a recordingdevice which is in keeping with the recording medium is used as therecording device 72. The recording device of a large capacity isroutinely used. However, a recording device of a small capacity sufficesfor recording only the program ancillary data.

The recording medium may be exemplified by a CD-ROM, a magneticrecording type medium, such as tape, floppy disc, hard disc or amagnetic card, an optical recording medium, such as write-once CD, DVDor optical card, magneto-optical recording type medium, such as DVD, MDor MO, and a semiconductor memory, such as non-volatile memory. Forrecording, an electrical method of changing the magnetism or the lightvolume depending on data for recording on a recording medium, or amethod exploiting the semiconductor producing technique, that is amethod consisting in creating a master disc and a stamper, may be used.

A transmitter 73 is means for transmitting or distributing to theaudience the picture program data or the program ancillary data, over awired route, such as optical cable, a power supply line or a telephoneline, or a radio path, such as by surface waves or satellite waves, ineither the broadcast configuration or in the communicationconfiguration.

FIG. 30 shows am illustrative structure of a system in a routine systemwithin a broadcasting station or within the picture creation businessoperator. Meanwhile, the functions of the creation device for programancillary data may be enclosed within the existing picture programediting device. FIG. 32 shows an illustrative structure of apictureprogram editing device fitted with a program ancillary data creatingfunction.

A picture program editing device 75, shown in FIG. 32, includes adisplay controller 75A, a controller 75B, a system controller 75C, adisc controller 75D, a hard disc device 75E, a special effect pictureprocessing unit 75F, a picture input/output unit 75G, a video taperecorder (VTR) 75H, a speech input/output/mixer unit 75I, a programancillary data processing unit 75J, an operating input unit 75K and adisplay device 75L.

In FIG. 32, the are shown connected outside the main body unit of thedevice. However, the operating inputting unit 75K and the display means75M may also be connected as one to the main body unit of the device, asin the case of a notebook personal computer, a PDA and a portabletelephone set. Although the hard disc device 75E and the video taperecorder 75H are shown enclosed in the main body unit, these may also beconnected to outside the main body unit. For external connection, wiredconnection, either serial or parallel, may be used, in which case acoaxial cable, a twisted pair cable or an optical fiber may be usedwithout any limitations. Alternatively, wireless connection may also beused without regard to the bandwidth. The spread spectrum system, suchas Bluetooth, may also be used.

The display controller 75A is means for reproducing and outputtingpicture data in signal forms (data forms) conforming to the displaymeans 75M. Output signals may, for example, be a video output (NTSCvideo, composite video and S-video) and an RGB output. The displaycontroller 75A includes a data decoding function, such as one providedby MPEG (Moving picture Experts Group), depending on the purposes ofuse.

The controller 75B is means for controlling respective parts orcommanding signal processing responsive to commands input through theoperating input unit 75L, and is routinely configured as amicro-processor. The system controller 75C is means for controlling thewrite/readout control or signal processing for the video tape recorder75H and, similarly to the controller 75B, is configured as amicro-processor. The functions of these controllers are prescribed by anoperating program or by an application program.

The disc controller 75D is means for controlling write/readout of thehard disc device 75E. In the hard disc device 75E, there is storedpicture data or acoustic data being edited. The picture special effectprocessing unit 75F is means for applying optional special effects, asspecified by an editor, to picture data read out through the pictureinput/output unit 75G. For example, two-dimensional effect processing,such as wiping, superimposing, key synthesis, enlarging or contracting,or the three-dimensional effect processing, is carried out. The picturespecial effect processing unit 75F is routinely constructed inconjunction with a switcher.

The picture input/output unit 75G is means for effecting picture datawrite/readout between it and plural video tape recorders 75H. Each videotape recorder 75H has recorded therein picture program data as thepicture material or the pre-edited picture program data.

The speech input/output/mixer unit 75I is means for reading/writingacoustic data between it and the plural video tape recorders 75H and formixing the acoustic data. Although a video tape is used in FIG. 32 asstorage means for picture program data as editing material or pre-editedpicture program data, an optical disc device or the like large capacitymedium may also be used.

The processing unit 75J for program ancillary data is means forimplementing the functions of the aforementioned creating device 63 forprogram ancillary data. That is, the program ancillary data generatingfunction or the index picture creating function etc. is carried out. Thebus 75K is a data input/output bus and may, for example, be an ISA bus,an EISA bus or a PCI bus.

The operating input unit 75L may be exemplified by a keyboard, a mouse,a pointing device, such as pad, pen or pointer, a dial, having or nothaving a click function, and a pushbutton key. The display device 75M isa device used for displaying an input picture for program ancillary dataand other pictures. A monitor device is routinely employed. Forhousehold use, a picture of a television receiver is used. In the caseof a portable device, a small-sized lightweight type display device,such as a liquid crystal display device, is used.

A picture program editing device 75 may be formed by computer terminals,such as notebook or desktop personal computers, PDA, portable telephonesets, game machines, set top boxes, PC card, domestic electricalutensils, VTR, television receivers, car navigation systems, wristwatches having the information processing functions, distributionterminals for music or games, financial terminals (ATM) etc., inaddition to the so-called dedicated terminals.

(b) Data Creating Picture

A typical display of a creating picture, demonstrated on the displaymeans 63M during creation of the program ancillary data, is hereinafterexplained.

(b-1) Typical Display 1

A first display picture 77 of FIG. 33 is explained. A display picture 77of FIG. 33 is made up of a title bar 77A, an input item display area77B, in which the information relevant to the commodities or services tobe input as the information pertinent to a scene to be created, and analready input information display area 77C for demonstrating the stateof correlation of the commodity or service data with each scene alongthe time axis.

Meanwhile, FIG. 33 is used for creating the program ancillary dataconcerning the commodities or services pertinent to the sponsorship. So,only a list of the commodities or services relevant to the sponsor isshown in the input item display area 77B. However, the informationpertinent to commodities or services not included in the sponsors mayalso be displayed.

In the input item display area 77B, there is demonstrated the specifiedinformation pertinent to the parties furnishing the commodities orservices included in the sponsor and to the commodities or servicesfurnished. The information pertinent to the commodities or services areprovided with icons for facilitating the confirmation on the picture.These icons are adapted to enable discrimination of the correspondingcommodities or services from the display configuration or color and fromthe letter information. In FIG. 33, a symbol comprised of thecombination of Roman letters representing the sponsor and numericalfigures representing the commodities or services furnished by thesponsor is allocated to each icon.

The already input information display area 77C is made up by a time codecolumn 77C5, as time axis, a picture column 77C1, representing thecontent of each scene, an acoustic column 77C2, representing the effectsound used in each scene or the content of the BGM, a data column 77C3,representing the information pertinent to the commodities or servicesinput as program ancillary data, and a list column 77C4, providing arange of plural scenes displayed in a list in the same picture. In thedisplay areas of these picture columns, the index pictures of therespective scenes, icons (picturesque symbols) representing the contentof the sound used in each scene, icons (picturesque symbols)representing the content of the commodities or services associated witheach scene and the scope of the scenes of interest, represented by e.g.,bar graphs, are displayed.

It is noted that the index pictures represented in the picture column77C1 may be created within the program ancillary data creating device63, that is within the index picture creating unit 63G, or the indexpicture used in the picture editing device 75 may be used.

There are several methods of allocating the information pertinent to thecommodities or services to the data column 77C3. One such method is todrag and drop the icon selected in an input item display area 77B. Inthis case, the operator may drop the selected icon on an index pictureof a corresponding scene, or in a data column of the correspondingscene. Without regard to the input method used, the picturesque symbols,indicating the content of the commodities or services input, aredisplayed in the relevant positions of the data column 77C3.

Meanwhile, if the information on the level of the name of the sponsorhas already been finished in the primary input system (the inputting ofthe Roman letters [A] or [B] has already been finished in the case ofFIG. 33), the display on the picture is replaced by the dropped contentby the aforementioned drag and drop operation. For example, the displayof [A] is replaced by display [A-1].

The inputting method is not limited to the drag and drop system. Forexample, the inputting to the data column 77C3 may be made in such amanner that selection of an icon comprised only of the name of thesponsor displayed in the data column 77C3, such as by clicking, causesthe display of the candidate for selection in the input item displayarea 77B to be changed, for example, to flicker or be changed in color,with the inputting in the data column 77C3 being finished by theoperator specifying one of the candidates for selection.

Since there is a limit to the area that can be displayed, there are anumber of occasions where only one commodity or service is displayed,even although the information pertinent to plural commodities orservices is associated with one scene, as in the case of the displayshown in FIG. 33. Of course, there may be occasions where registrationof the information pertinent to plural commodities or services may benoticed from the display methods. For example, the display content maybe confirmed by parallel display of plural icons or overlapped display.

(b-2) Typical Display 2

However, if the icons are arrayed in parallel, or if the display area isshifted for overlapped display, it is unavoidable that the contentbecome difficult to confirm. So, a second display picture 78 shown inFIG. 34 is provided. In the display picture 78 shown in FIG. 34, anenlarged display window 77D of the data column 77C3 is indicatedoverlapped on the aforementioned first display picture 77.

FIG. 34 shows an instance where the number of the commodities orservices associated with a sole scene is approximately three (datacolumns in the drawing being 77C10, 77C20 and 77C30). Of course, thereare cases where three or more commodities or services are associatedwith each scene, in which case the portions not displayed in the displayarea may be adapted to be confirmed through the operation of a scrollbar provided on a picture, or the information displayed on the enlargeddisplay window 77D may be limited to the content of the data column 77C3to enable more information to be displayed.

Meanwhile, there are also occasions where it is desirable to confirm, atone glance, the information concerning the same commodities or servicesappearing at plural scenes in actual editing operations. If, in thiscase, the controller 63D is caused to execute such a function in which,when an operator performs an operation of specifying the commodities orservices of the input item display area 77B as he or she depresses anoperating key associated with the function in question, display of therelevant information in the data column 77C3 is changed, for example,the display flickers or is changed in color, the editing operation canbe improved in efficiency. As the method of implementing a similarfunction, it may be envisaged to reverse the operating sequence, forexample, to initially specify certain commodities or services of theinput item display area 77B and to then depress an operating key towhich the function in question is allocated. This function can beexploited even on the first display picture 77.

(b-3) Typical Display 3

By providing the above-described two display pictures, the operatorengaged in an editing operation is able to confirm which informationpertinent to commodities or services is associated with which scene.Meanwhile, it should be possible how such information is presented tothe audience, otherwise the system would be practically unusable.

So, a third display picture 79, shown in FIG. 35, is provided. Thispicture indicates how the information pertinent to plural commodities orservices associated with a given scene is to be demonstrated. That is,this picture is a display example for a meta-pocket in the presentspecification. This picture will be explained in detail later inconnection with the explanation of the audience side system. In FIG. 35,only schematics are explained.

In the display picture 79, there are displayed an information displaycolumn 79A indicating the identification code information of the programancillary data and the detailed information on the commodities orservices, jump buttons 79B to 79D in which is embedded the linkinformation to other display pictures associated with the displaypicture 79, and an exit button 79E to which is associated the operationof closing the display picture.

The display content of the information display column 79A areoperatively linked with the input results in the first and seconddisplay pictures. In case the display on the information display column79A is inappropriate, the display position on the picture is corrected.The information in question is ultimately output as the programancillary data. The so generated program ancillary data is recorded inthe program ancillary data recording unit 63C.

Meanwhile, a meta-cart 79B, among the jump buttons, is a button used forjumping to a picture for confirming the information pertinent to thecommodity the audience desires to purchase and which has not beendefinitely transmitted to the brokerage business operator. Since thereis no other picture in the editing stage than a template pictureprovided from the outset, no explanation is given on an exemplarypicture.

(b-4) Typical Display 4

FIG. 36 shows a fourth display picture 80. This display picture 80,which is a display example of a picture demonstrated in case a meta-mall79C as one of the jump buttons shown in FIG. 35 is depressed,corresponds to the content of the list column 77C4 of FIG. 33.

FIG. 36 shows a typical picture 80 in case meta-pockets of threedifferent scenes are to be recognizable on a sole picture. In FIG. 36,index pictures are displayed in association with each scene to permitfacilitated recognition of each scene. In the display picture, since thedisplay area 80A that can be allocated to one scene becomes narrowerthan with the meta-pocket, only several information of each meta-pocketare selectively demonstrated. As a method for selective display, it maybe contemplated to demonstrate a preset number of information from theleading end of each meta-pocket.

(b-5) Typical Display 5

FIG. 37 shows a fifth display picture 81. This display picture is adisplay example of a picture demonstrated when a commodity informationsite 79D, among the jump buttons shown in FIG. 35, is depressed. Thisdisplay picture is used for confirmation for such a case where a displaypicture of the information concerning the individual commodities orservices is provided at the data creating device for program ancillarydata.

However, in case the information is on a home page of the sponsorbusiness operator or on a home page of a brokerage business operator, itis generally unnecessary to confirm the content of the information, andhence the function in question is unneeded, although the home page inquestion may be optionally accessed to confirm its content.

(c) Processing Operations

Finally, the processing operations in the editing operation employingthe program ancillary data creating device 63 are explained.

FIG. 38 shows an operating sequence under a condition in which noinformation has been registered in the data column 77C3 in the alreadyinput information display area 77C of FIG. 33. The controller 63D readsout the layout information corresponding to the display example 1 (FIG.35) from the layout information holding unit 63H. The controller 63Dthen causes the information concerning the sponsorship-related goods orservices, pertinent to the picture program in question, as read out fromthe database for commodities or services 66, to be displayed in theinput item display area 77B. Simultaneously, the controller 63Ddemonstrates the index picture, as read out from the picture editingdevice or the index picture creating unit 63G, in association with thecorresponding scene (step S41).

In this state, the controller 63D verifies whether or not an iconrepresenting the commodities or services demonstrated in the input itemdisplay area 77B has been selected (step S42). This decision operationis repeated as long as negative results persist. When the operator makesselection and affirmative results are obtained, the controller 63Dcauses the corresponding information to be displayed in the data column77C3 corresponding to the index picture to which the selected icon hasbeen dragged and dropped (picture column 77C1). Although the icon dropdestination is the index picture display column, it may also be the datacolumn 77C3.

The next operation is carried out in accordance with FIG. 39. Thecontroller 63D reads out the layout information corresponding to thedisplay example 1 (FIG. 35) from the layout information holding unit63H, while displaying on the input item display area 77B the informationconcerning the sponsorship-related commodities or services pertinent tothe picture program as read out from the database for commodities orservices 66. The controller 63D also displays the index picture, readout from the picture editing device or the index picture creating unit63G, in association with the corresponding scene, while reading out thepreviously input information concerning the commodities or services fromthe input data recording unit 63B to display the so read out informationin the data column 77C3 (step S45).

In this state, the controller 63D verifies whether or not the iconrepresenting the commodities or services displayed in the input itemdisplay area 77B has been selected (step S46). This decision operationis repeated as long as negative results prevail. When the operator makesselection and affirmative results are obtained, the controller 63Dcauses the corresponding information to be displayed in the data column77C3 corresponding to the index picture to which the selected icon hasbeen dragged and dropped. Although the icon drop destination is the datacolumn 77C3, it may also be the index column (picture column 77C1), asin the example of FIG. 38.

By repeating the operation of FIG. 39, the information concerning thecommodities or services making up the program ancillary data is input.

(C-4) Summary

By constructing the above-described creating system for programancillary data, the inputting and the editing of the voluminousinformation on the commodities or services indispensable for therealization of data broadcast or distribution attractive to the audiencecan be realized efficiently. In particular, since this enables effectiveutilization of the information concerning the commodities or servicesaccumulated in arriving at the sponsorship tie up for commodities orservices for picture programs, the operating efficiency is improved notonly on the working site for program creation but also on the workingsite for editing.

(D) Digital Picture Program Receiving Reproducing System

The digital picture program receiving system may be roughly divided intoan audience side system receiving or reproducing the digital pictureprogram and an brokerage business operator side system which links theinterest on the part of the audience concerning the commodities orservices as imaged objects to the information furnishment and commercialtransactions. These respective systems are hereinafter explained.

(D-1) Program Ancillary Data Processing Device

(a) Terminal Structure

The program ancillary data processing device, forming the audience sidesystem, is classified into a device directly receiving or reproducing adigital picture program, referred to below as a primary terminal, and adevice receiving the necessary information transferred from the primaryterminal, referred to below as a secondary terminal. Meanwhile, themethod for acquiring the digital picture program includes a method forreceiving the digital picture program through ground or satellite waves,that is over a radio path, a method for receiving the digital pictureprogram through a cabled network, such as telephone line, inclusive ofISDN, an optical fiber network or a cable television network, and amethod for reproducing the digital picture program from a recordingmedium.

Meanwhile, the program ancillary data processing device may also be ahybrid device, also having the function of demodulating or decodingprogram data and the outputting function, instead of being dedicated tothe processing of the program ancillary data.

(a-1) Primary Terminal

FIGS. 40 to 43 show four embodiments of the primary terminal. In any ofthese cases, a reproducing device 85M, an operating input device 85N anddisplay means 85O are shown connected outside of the main body unit ofthe device, these may also be formed as one with or enclosed within themain body unit. Conversely, respective functional units or recordingunits may also be connected outside of the main body unit of the device.Needless to say, the connection between the main body unit and theexternal device may be wired or wireless. As for the method forcommunication or transmission between the devices, specified connectionsystems may be used.

Referring first to FIG. 40, a processing device 85 for program ancillarydata includes a display controller 85A, an number of times of accesscalculating unit 85B, an input data recording unit 85C, a programancillary data recording unit 85D, an extraction unit for programancillary data 85E, a controller 85F, a receiving unit 85G, an indexpicture recording unit 85H, a communication unit 85I, an index picturecreation unit 85J, a commodity/service information presence/absencedecision unit 85K, a bus 85L, a reproducing device 85M, an operatinginput unit 85N and display means 85O.

The display controller 85A is means for reproducing and outputtingreceived or reproduced picture data in signal forms (data forms)conforming to the display means 85O. Output signals may, for example, bea video output (NTSC video, composite video and S-video) and an RGBoutput. The display controller 85A includes a data decoding function,such as one provided by MPEG (Moving Picture Experts Group), dependingon the usage and application.

The received wave may be in the broadcast form or in the communicationform. In any of the transmission configurations, the propagation path ofthe received wave includes a radio path, such as ground or satellitewaves, and a cabled path, such as a telephone line, a data line and anoptical fiber.

The number of access times calculating unit 85B is means for calculatingthe number of times of access events on the scene basis, based on thenumber of times of access events on the commodity or service basis. Thisunit is unnecessary for a terminal not having or not in need of thefunction of displaying the number of times of access events on the scenebasis. The unit is similarly unnecessary for such a case where thenumber of times of scene-based access events can be acquired asreproduced data or as received data inclusive of data receivedindependently of the digital picture program.

The number of access times calculating unit 85B calculates the sum ofthe number of times of access events to the commodities or servicesappearing as imaged objects in each scene, usually only the commoditiesor services appearing in the program ancillary data, in terms of thenumber of times of the access events to the scene in question, withoutregard to the route of acquisition of the information on the number ofindividual access events pertinent to the commodities or services. Thecalculated results are used when displaying the content of the programancillary data on the picture such as when displaying meta-pockets ormeta-malls. That is, even when the information on the scene-based accessevents is not included in the program ancillary data received orreproduced, the number of times of access events representing thescene-based interest entertained by the audience can be correlativelydisplayed.

As for the acquisition route, the information may be acquired as pictureprogram data, that is as program ancillary data along with the programdata, as program ancillary data by itself or as the number of times ofaccess events by itself. The transmission medium may be wired orwireless. The information may also be acquired as replay data from therecording medium.

The input data recording unit 85C is a recording or storage medium usedfor recording data input through the operating input unit 85N forcommunication purposes. These mediums may be exemplified by a CD-ROM, amagnetic recording type medium, such as tape, floppy disc, hard disc ora magnetic card, an optical recording medium, such as write-once CD, DVDor optical card, magneto-optical recording type medium, such as DVD, MDor MO, and a semiconductor memory, such as non-volatile memory or RAM.Of these, a RAM is felt to be routinely used.

It is unnecessary for the input data recording unit 85C to be arecording unit dedicated to recording the input data. For example, it isnaturally possible to use the physically same medium for the input datarecording unit 85C as the recording unit 85D for program ancillary data,if only the recording area used is a different area. Meanwhile, theinput data recording unit 85B may be provided within the displaycontroller 85A.

The recording unit 85D for program ancillary data is a recording orstorage medium for recording the program ancillary data acquired asreceived or reproduced data. The medium used is routinely a RAM,however, as in the case of the input data recording unit 85C, there isno particular limitation to the sort of the medium provided that itallows for writing program ancillary data. There is also no necessityfor the recording unit 85D for program ancillary data to be a recorderdedicated to recording the program ancillary data. For example, themedium which is physically the same as the aforementioned input datarecording unit 85C may be commonly used.

The extraction unit for program ancillary data 85E is means forseparating and extracting the program ancillary data from the receivedor reproduced picture program data. FIG. 20 shows typical programancillary data. This function may be implemented in dedicated hardwareor as software.

The controller 85F is means for controlling various components of theprocessing device for program ancillary data 85 and for executing signalprocessing, and is generally configured as a micro-computer. Thefunction of the controller 20F is routinely prescribed by the operationprogram and by the application program.

The receiving unit 85G is a unit for receiving picture program data orprogram ancillary data transmitted over a wired or wireless path, andexecutes preset demodulation and decoding.

The index picture recording unit 85H is a recording or storage mediumfor recording an index picture extracted from the program ancillarydata, an index picture received from outside over a communication path,for example, from a brokerage database acting as an intermediary forcommercial transactions, or a picture for recording an index picturecreated in the program ancillary data processing device 85.

These mediums may be exemplified by a CD-ROM, a magnetic recording typemedium, such as tape, floppy disc, hard disc or a magnetic card, anoptical recording medium, such as write-once CD, DVD or optical card,magneto-optical recording type medium, such as DVD, MD or MO, andsemiconductor memory, such as non-volatile memory or RAM. However, a RAMis felt to be routinely used.

The communication unit 85I is means for communication with an externalterminal over a network, which may be wired or wireless. In case abidirectional path is used for receiving program ancillary data orpicture program data, the receiving unit 85G and the communication unit85I may be used in common.

The communication unit 85I is used in case the audience feels that thecontent of the program ancillary data displayed on the display pictureis insufficient and accesses an external database, that is downloads themore detailed information concerning the commodities or services asimaged objects, or in case the intention to purchase the commodities orservices as imaged objects is to be transmitted. It is also used forindividually downloading the program ancillary data.

The index picture creation unit 85J is means for creating an indexpicture based on a representative frame picture used for confirming thecontent of the program ancillary data. Since the index picture is usedfor confirming a corresponding scene, it is generated as a picture thepicture information of which is reduced in picture quality as comparedto the picture used for real broadcast. It is, however, not mandatory tolower the picture quality such that the index picture may be of the sameinformation as that of the actual broadcast.

Usually, a frame picture representative of the content of each scene isused as an index picture. Examples of the index picture include aleading frame of a corresponding scene, a frame which permitsfacilitated recognition of the sponsorship-related commodities orservices, as selected by the audience, and a trailing end frame of thecorresponding scene. If the rule for selecting the frame picture in thismanner is set, the index picture creation unit 85J is able to create theindex picture automatically. However, if the selection by the audienceis resorted to, the frame picture at the time point (time code) asspecified by the operating input unit 85N is used. Additionally, theindex picture may be represented with computer graphics.

Meanwhile, in case the index picture can be acquired by itself or as apart of the program ancillary data, there is no necessity for the indexpicture creation unit 85J to be provided in the device. However, if atime point scene used by the audience as an index picture is to bearbitrarily selectable, there is meaning in providing the index picturecreation unit 85J.

The commodity/service information presence/absence decision unit 85K ismeans which, in case there is embedded the identification informationspecifying whether or not the information on the commodities or servicesis contained in the program ancillary data, renders it possible todiscriminate, without the necessity of analyzing the data content,whether or not the program ancillary data being processed has to do withcommodities or services.

If this decision unit is used, the program ancillary data containing theinformation pertinent to commodities or services can be distinguishedfrom other program ancillary data with only a small signal processingvolume. Moreover, only the program ancillary data containing theinformation pertinent to the commodities or services can be selectivelysent to the display controller 85A for display on the display picture orstorage in a recording medium.

Moreover, if, in case of creating an index picture within a programancillary data creating device, there is not contained the informationpertinent to commodities or services, there is no necessity forconfirming the commodities or services on the index picture, so that thecreation of the index picture may be dispensed with. However, thisapplies only for a case where the index picture is used exclusively forconfirming the commodities or services, such that, if the index pictureis used for other purposes, creation of the index picture may benecessary.

Meanwhile, should the information pertinent to the subject-matter of thesponsorship be included in the program ancillary data, a sponsorinformation presence/absence decision unit, similar to thecommodity/service information presence/absence decision unit 85K, may beprovided for verifying, from the relevant information in the programancillary data, whether or not there is contained the informationconcerning the subject-matter of the sponsorship.

These decision units are particularly effective when a display picture(meta-pocket in the present specification) used for collecting theinformation pertinent to the commodities or services appearing as animaged object in each scene in the aforementioned supplementaryinformation data creating system into one is not prepared.

For example, such a use becomes possible in which, if the componentunits of the program ancillary data contained in the received orreproduced signal are commodities or services, the program ancillarydata relevant to the same scene is first extracted, using theinformation specifying each scene, such as UMID or time code, as aretrieving key, and in which the data pertinent to commodities orservices or the data pertinent to the sponsorship is then sorted andextracted, using the aforementioned decision units, with the meta-pocketbeing then created from the sorted information pertinent to thecommodities or services.

The bus 85L is a data input/output bus, which may, for example, be anISA, EISA pr PCI bus. The reproducing device 85M is means forreproducing the picture program data or program ancillary datadistributed as recording medium. For the reproducing device 85M, such adevice which is in keeping with the recording medium having pictureprogram data or the program ancillary data, recorded thereon, ispreferably used. Since a large capacity medium is required for programdata, DVD or MO is presupposed as medium. For program ancillary data, adata volume smaller than that for picture program data suffices, andhence a non-volatile memory or a CD-ROM etc. is presupposed in additionto the above mediums. However, the possible storage capacity is changedappreciably with the progress in technology and the debut of a newmedium needs to be taken into account. Consequently, there is nolimitation as to the name or the compatibility relationships of thestorage mediums used. The same holds for other mediums.

The operating input unit 85N may be enumerated by, for example, akeyboard, a mouse, a pointing device, such as pad, pen or pointer, adial, having or not having a click function, and a pushbutton key. Aremote controller may also be used.

The display means 85O is a device used for confirming the content of theprogram ancillary data. In general, such display means which is alsocapable of displaying a picture program is used. In general, a displaypicture of a television receiver or a monitor device may also be used.In the case of a portable device, a liquid crystal device or the likesmall-sized lightweight display device is used.

The terminal operating as ‘program ancillary data processing device’shown in FIG. 40 includes, in addition to dedicated devices forprocessing program ancillary data, computer terminals, such as notebookor desktop personal computers, portable information terminals (PDA),portable telephone sets, game machines, set top box, PC card, domesticelectrical utensils, VTR, television receivers, car navigation systems,wrist watches having the information processing functions, and remotecontrollers. The same holds for the program ancillary data processingdevices hereinafter explained.

Reference is now made to FIG. 41 in which the parts or components sameas those of FIG. 40 are indicated by the same reference numerals. FIG.41 differs from FIG. 40 in that a selection scene position recordingunit 85P is substituted for the commodity/service informationpresence/absence decision unit 85K. The selection scene positionrecording unit 85P is a recording or storage medium for the audience torecord the information of the scene position selected as the displayposition of the program ancillary data. Usually, a RAM is used for thisrecording unit. However, other mediums may also be used.

By providing the function in question, selection of the scene positiondisplayed as an index picture may be up to the discretion of theaudience. In particular, since the audience may be interested in a widevariety of commodities or services, the index picture provided by thepicture producer is not necessarily suitable to the commodities orservices in which the audience is interested. By providing the abovefunction, the scene position that can be readily recognized by theaudience may be adopted as the index picture. In case the selectingfunction on the part of the audience is to be displayed in creating theindex picture, the selection scene position recording unit 85P needs tobe provided in the case of FIG. 40.

Reference is now made to FIG. 42 in which the parts or components sameas those of FIG. 40 are indicated by the same reference numerals. FIG.42 differs from FIG. 40 in that an index picture extraction unit 85Q issubstituted for the index picture creation unit 85J and in that ameta-pocket/meta-mall creation unit 85R is substituted for thecommodity/service information presence/absence decision unit 85K.

The index picture extraction unit 85Q extracts an index picture when oneis contained in the received data or reproduced data, without regard towhether the index picture is contained as a part of the programancillary data or is contained by itself.

The meta-pocket/meta-mall creation unit 85R is means for creating, incase the meta-pocket or the meta-mall is not included in the programancillary data, the corresponding information, based on the programancillary data received or reproduced. The meta-pocket is the programancillary data which corresponds to the information pertinent tocommodities or services appearing in a specified scene and whichroutinely includes the layout information, whereas the meta-mall is theprogram ancillary data which is adapted for enabling plural meta-pocketsassociated with respective plural scenes to be viewed at a glance in onepicture, and which routinely includes the layout information.

Meanwhile, the meta-mall can be created from the metadata concerningplural scenes, as determined under a specifying rule or subject todesignation by the audience, or can be created from the informationpertinent to individual commodities or services.

Reference is now made to FIG. 43 in which the parts or components sameas those of FIG. 40 are indicated by the same reference numerals. FIG.43 differs from FIG. 40 in that an external data presence/absencedetection unit 85Q is substituted for three units, namely the indexpicture recording unit 85H, index picture creation unit 85J and thecommodity/service information presence/absence decision unit 85K.

The external data presence/absence detection unit 85Q is means effectivewhen data (flags) indicating the external presence of the informationpertinent to the corresponding scene in the program ancillary data areused. This is effective when the data volume of the program ancillarydata is to be reduced in data volume or when services are to be renderedto members. That is, since the information on the commodities orservices significant for the audience is not contained in the programancillary data received or reproduced, the data volume is appreciablyreduced, while the information may be adapted for not being furnished tothe audience except specified members.

If the presence of the external data is detected in the external datapresence/absence detection unit 85Q, the external database etc. isaccessed through the communication unit 85I to download the necessaryinformation. Meanwhile, the information concerning the accessed site maybe pre-registered, or recorded in the program ancillary data. Ifservices are rendered to specified members, authentication means, notshown, are used.

(a-2) Secondary Terminal

FIG. 44 shows an embodiment of the secondary terminal. Although FIG. 44shows a case where any functional units are enclosed or unified in amain body unit of the device, these may be externally connected to themain body unit. The connection between the main body unit and theexternal device may be wired or wireless. As for the method forcommunication or transmission between the devices, specified connectionsystems may be used.

Meanwhile, a typical structure of the secondary terminal is shown as inFIG. 44 because a portable type terminal is presupposed as a secondaryterminal. The secondary terminal may, of course, be a standstill device.The typical structure is convenient when the primary and secondaryterminals are differentially used, as when the primary terminal is usedin the user's premises and the secondary terminal is used outdoors. Inthis consideration, FIG. 44 shows an example of acquiring the necessaryinformation by wireless communication with the primary terminal (programancillary data processing device) 85, such as television receiver. Ofcourse, wired connection may be used as the connection between thesecondary and primary terminals.

FIG. 44 shows a program ancillary data processing device 87 including adisplay controller 87A, a program ancillary data recording unit 87B, aninput data recording unit 87C, a controller 87D, a communication unit(downloading unit) 87E, a bus 87F, an operating input unit 87G anddisplay means 87H. Although not shown in FIG. 44, data used in thesecondary terminal may be acquired from the primary terminal in the formof a recording medium. In this case, a reproducing device is required.

The display controller 87A is means for reproducing and outputtingreceived or reproduced picture data in signal forms (data forms)conforming to the display means 87H. Output signals may, for example, bea video output (NTSC video, composite video and S-video) and an RGBoutput. The display controller 87A includes a data decoding function,such as one provided by MPEG (Moving Picture Experts Group), dependingon the usage and application.

The program ancillary data recording unit 87B is a recording or storagemedium for recording the program ancillary data received and reproduced.These recording mediums include a CD-ROM, a magnetic recording typemedium, such as tape, floppy disc, hard disc or a magnetic card, anoptical recording medium, such as write-once CD, DVD or optical card,magneto-optical recording type medium, such as DVD, MD or MO, and asemiconductor memory, such as non-volatile memory or RAM. Of these, theRAM is felt to be routinely used.

It is unnecessary for the program ancillary data recording unit 87B tobe a recording unit dedicated to recording the input data. For example,it is naturally possible to use the physically same medium for the inputdata recording unit 87C as the data recording unit for program ancillarydata 87D if only the recording area used is a different area.

The input data recording unit 87C is a recording or storage medium forrecording data input through the operating input unit 87G forcommunication purposes. The medium used is routinely a RAM. However, asin the case of the program ancillary data recording unit 87B, there isno particular limitation to the sort of the medium provided that itallows for writing input data. It is unnecessary for the input datarecording unit 87C to be a recording unit dedicated to the recording ofthe input data. On the other hand, the input data recording unit 87C maybe provided within the display controller 87A.

The controller 87D is means for controlling various components making upthe program ancillary data processing device 87 and for carrying outsignal processing, and is configured as a micro-computer. Usually, thefunction of the controller 87D is prescribed by the operation system andby the application program.

The communication unit 87E is means for communication with outside,especially with the primary terminal 85, to acquire the necessaryinformation. The communication path may be wired or wireless, asaforesaid. The same holds for the case of communication with an externalequipment other than the primary terminal.

The bus 87E is an input/output bus for data, such as an ISA bus, an EISAbus or a PCI bus. The operating input unit 87G may, for example, be akeyboard, a mouse, a pointing device, such as pad, pen or pointer, adial, having or not having a click function, and a pushbutton key. Aremote controller may also be used.

The display means 87H is a device used for confirming the content of theprogram ancillary data. In the case of a portable device, a small-sizedlightweight display device, such as a liquid crystal device, may beused. In the case of a standstill type device, a monitor device or atelevision receiver may be used.

The terminal operating as the ‘program ancillary data processing device’shown in FIG. 44 includes, in addition to dedicated devices forprocessing program ancillary data, computer terminals, such as notebookor desktop personal computers, portable information terminals (PDA),portable telephone sets, game machines, set top boxes, PC cards,domestic electrical utensils, VTR, television receivers, car navigationsystems, wrist watches having the information processing functions, andremote controllers 15.

(b) Display Picture Example

Next, display picture examples of the program ancillary data processingdevices 85, 87 are explained.

(b-1) Presence Notice Picture of Program Ancillary Data

FIGS. 45 and 46 show a picture display example in a scene where theprogram ancillary data pertinent to the commodities or services, such asmeta-mall or meta-pocket (list file), are associated with the pictureprogram (real broadcast). It is noted that this picture display is madewhen the display function notifying to the audience that the programancillary data pertinent to the commodities or services is so associatedis set to the [ON state] by the audience. If conversely the audiencesets the function to the [OFF state], display of FIGS. 45 and 46 is notmade.

FIG. 45 shows a display example in case of divisionally demonstratingthe display area into a real broadcast area 90 and an auxiliaryinformation area 91. In the case of FIG. 45, a notice symbol 91A of ascene, with which the program ancillary data pertinent to thecommodities or services is associated, is demonstrated in the auxiliaryinformation area 91. On the other hand, FIG. 46 shows a display examplein case of using the entire display area for the real broadcast area 90.In FIG. 46, the notice symbol 91A for the scene with which the programancillary data is associated is displayed superimposed on the realbroadcast picture. It is similarly possible in the case of FIG. 45 todisplay the symbol in superimposition on the real broadcast picture.

There may also be envisaged a method of changing the display of anindicator provided on a front panel of an electronic equipment, such asa remote controller or a television receiver, such as by lighting,flicker or change of display color, or by producing an alarm sound.

(b-2) Display Example of Meta-Pocket

(1) Meta-Pocket Display Example

FIGS. 47 to 50 show a display picture example of the informationpertinent to the commodities or services appearing in each scene, thatis a display example of a meta-pocket, as is so termed in the presentspecification. It is noted that the meta-pocket may be received orreproduced as program ancillary data or may be created by signalprocessing in the program ancillary data processing device.

FIGS. 47 to 49 shows examples of display pictures having the same layoutstructure. Meanwhile, FIG. 47 is directed to a display example of amotion picture, drama or a variety program, FIG. 48 is directed to adisplay example of a sports program and FIG. 49 is directed to a displayexample of the information pertinent to the music or pictures used inthe picture program. In these figures, the content conforming to theobject is displayed as the information on the commodities or services.

First, the layout structure common to these display pictures 93 isexplained with reference to FIG. 47. These display pictures each includean identification number display column 93A, as meta-pocket managementinformation, a scene-based access information display column 93B, adisplay column for the information pertinent to commodities or services93C, an access information display column on the commodity or servicebasis 93D, a meta-cart button jump button 93E embedding the linkinformation to the meta-cart, a meta-mall jump button 93F, embedding thelink information to the meta-mall, a commodity information site jumpbutton 93G, embedding the link information to the detailed informationpertinent to commodities or services as selected on the picture, apurchase button 93H used for inputting the intention to purchase and anend button 93I for finishing the meta-pocket display. The scene-basedaccess information display column 93B sums the access states from theaudience to the commodities or services appearing in the meta-pocket, onthe scene basis. The access information display column on the commodityor service basis 93D shows the accessing information from the audienceto the commodities or services appearing in the meta-pocket in question.

In the case of FIG. 47, the audience is able to acquire, at a time, theinformation pertinent to plural objects appearing in an associatedscene, for example, the information pertinent to the commodities orservices, such as performer's apparel, hair making, sunglasses, tables,sofas, location equipment etc. These information are relevant to theapparel or small articles, worn by the performers, or the fitting usedin e.g., a studio, in distinction from the information pertinent to thecommodities or services for so-called television shopping, and hencehave not so far been taken into account in connection with informationfurnishment.

Since these information are displayed, the business operator whichfurnished the commodities or services are given the opportunity of newadvertisement and hence the opportunity for latent businesstransactions. On the other hand, the audience is given the informationpertinent to the commodities or services in which the audience isinterested, rather than the information of insipid uniformity.

In the case of FIG. 47, only the classification of the commodity items,names of commodity, name of the sponsor business operator and the URL,are indicated in the display column for the information pertinent tocommodities or services 93C, to display in front the function as aplatform for acquiring the information pertinent to the commodities orservices. Alternatively, the information pertinent to the prices of thecommodities or services or the information pertinent to the sellingstore can be confirmed on the picture.

Meanwhile, the number of times of access events, displayed in thescene-based access information display column 93B or in the accessinformation display column on the commodity or service basis 93D of FIG.47, may be the number of times the information is acquired by theaudience first selecting the commodities or services and subsequentlyacting on the commodity information site jump button 93G, or the sumtotal of the number of times until the purchase of the commodities orservices.

It may be contemplated that the information pertinent to the number oftimes of access events may be obtained not only from the informationfurnishing server connected to the premises of the audience over acommunication network, but also from the latest information directlybroadcasted or distributed from the broadcasting or distributing stationor acquired from a recording medium which has recorded the informationat a certain time point.

Examples of display pictures, demonstrated on actuating the meta-cartbutton jump button 93E, meta-mall jump button 93F and the commodityinformation site jump button 93G, will be explained later in detail.

In the case of FIG. 48, the information on the uniforms or shoes of aplayer appearing in an imaged object in a sports program, as well as theinstitution information concerning an arena or gymnasium, is obtainable.In the case of FIG. 49, the information concerning the performer of themusical sound used in the picture program, the information on BGM, orthe information concerning the editing technique or the special effecttechnique used in a picture program, is also obtainable.

Reference is now made to FIG. 50, which differs from FIGS. 47 to 49 inthat an index picture 93J is included among the objects for display. Ifa meta-pocket is displayed along with the real broadcast, the content ofthe meta-pocket can be confirmed in the real broadcast, however, thepicture of the real broadcast is usually changed. Thus, commodity itemscan be deliberately selected by having the index picture 93J displayed,even when the meta-pocket is displayed along with the real broadcast.

If the meta-pocket content is confirmed later, but the index picture 93Jfor a scene in question is displayed on the same picture along with theinformation pertinent to commodities or services, the necessaryinformation can be accessed without the audience having to resort to hisor her recollections, with the consequence that the meta-pocketconfirmation may be made a separate event from the viewing of the realbroadcast. This testifies to the increased practical value of themeta-pocket. If the viewer is usually busy, he or she may transfer themeta-pocket equivalent portion of the program ancillary data (metadata)of the picture program recorded on the household equipment to a portableterminal to confirm the content outdoors or to offer to purchase thecommodities or services he or she is interested in. The index picture93I, if displayed, is convenient in such case because the scene contentcan then be comprehended reliably.

(2) Meta-Mall Display Example

Referring to FIGS. 51 and 52, examples of display pictures fordisplaying a list of the information on the commodities or services forplural scenes on the same picture, that is display examples ofmeta-malls, so termed in the present specification, are explained. Themeta-mall in question may not only be received or reproduced as programancillary data, but also may be created in the signal processing in theprocessing device for program ancillary data.

First, the layout structure of FIG. 51 is explained. A display picture95 includes a meta-mall discrimination number display column 95A, asmeta-mall management information, a meta-pocket discrimination numberdisplay column 95B, as management information for meta-pockets,envisaged by the meta-mall to be displayed in a list, an index picture95C, representing the scene content of each meta-pocket, a displaycolumn 95D for the information on commodities or services, a meta-cartjump button 95E, embedding the link information to the meta-cart, acommodity information site jump button 95F, embedding the linkinformation to the detailed information pertinent to the commodities orservices as selected on the picture, a purchase button 95G used forinputting the will to purchase, a scroll button 95H, a purchase willcancel button 95I and a meta-mall display end button 95J.

Since plural scene information are displayed, as shown in FIG. 51, thedisplay area for one scene, that is meta-pocket, is limited, as a resultof which the number of items displayed per scene is also limited.Although a column for illustration of the commodities is provided in thedisplay example of FIG. 51 as display content of the informationpertinent to commodities or services, the column for illustration of thecommodities may also be omitted, as in the aforementioned displayexamples for meta-pockets. Conversely, the column for explanation of thecommodities may also be provided in the display picture examples of themeta-pockets as display content of the information pertinent tocommodities or services.

In the case of FIG. 51, an index picture 95C is demonstrated inassociation with each meta-pocket. This facilitates scene confirmationby the audience. The index picture may not be provided, in which case atarget scene must be identified based solely on the text information.

One or plural meta-malls 95 may exist for one picture program. In anycase, if all scenes making up the meta-mall cannot be demonstrated at atime, the scroll button 95H on the picture may be used to confirm thetarget scene.

FIG. 52 shows a second display example of a meta-mall 95. FIG. 52differs from FIG. 51 in that the meta-mall display end button 95J isdisplayed in each scene, and in that a commodity- or service-basedaccess information display column 95K is displayed for each of thecommodities or services.

The information on the sub-total of the numbers of times of accessevents, thus displayed from scene to scene, can be used as an index asto which is the scene where favorite commodities exist and also as anindex as to which are favorite commodities or services in each scene, asshown in FIG. 52.

(3) Meta-Cart Display Examples

FIG. 53 shows a display example of a meta-cart picture displayed onactuation of a meta-cart jump button on a meta-pocket picture or on ameta-mall picture. The meta-cart is a picture used for the viewer tore-confirm the content of the commodities or services to be purchasedbefore the viewer finally decides on the commercial transaction on thecommodities or services he or she has expressed the will to purchase.

Such a display picture 97 includes a meta-pocket discrimination numberdisplay column 97A, for specifying a scene to which belongs thecommodity desired to be purchased, a scene-based access informationdisplay column 97B, demonstrating the number of times of access eventsto a corresponding particular scene, an index picture 97C representingthe content of each scene, an commodity- or service-based accessinformation display column 97D, a commodity or service informationdisplay column 97E, a meta-mall jump button 97F embedding the linkinformation to the meta-mall, a purchase button 97G used for inputtingthe will to purchase, a commodity information site jump button 97H,embedding the link information to the detailed information pertinent tocommodities or services selected on the picture, a scroll button 97I anda meta-cart display end button 97J.

Since the index picture 97C is displayed in this manner in the meta-cartas a basket picture, the content of the commodities or services to bepurchased can be confirmed as a picture. Thus, in case the content ofthe commodities or services is desired to be confirmed, it isunnecessary to revert to the picture in which the purchase has beenentered, thus saving laborious inputting operations. Moreover, sincethis means saving in time needed until final decision of the will topurchase, the commercial transaction may be concluded in a shorter time,which is a merit for the business operator acting as an intermediary forcommercial transactions.

Since the scene-based or commodity- or service-based access informationis displayed, it is possible to check for popularity of the commoditiesor services among other viewers. So, when the viewer desirous to confirmthe popularity for given commodities or services, he or she is not inneed to revert to the picture in which he or she offered a purchase,thus saving laborious inputting operations. Meanwhile, there is nonecessity for displaying the scene-based access information.

Although only the meta-mall jump button 97F is displayed, themeta-pocket jump button embedding the link information to themeta-pocket may also be displayed, while both the meta-mall jump button97F and the meta-pocket jump button may be displayed.

(4) Commodity Information Site Display Example

FIG. 54 shows a display picture example of a commodity information site.This display picture is used for allowing to confirm the detailedinformation in case the information displayed in the meta-pocket or inthe meta-mall falls short. The information in the scene in question maybe stored in a server for which each business operator furnishing thecommodities or services has a home page, or in a server of the brokeragebusiness operator acting as an intermediary for the commercialtransactions between the audience and the business operator.

A display picture 98 includes a scene information display column 98A,pertinent to the commodities or services in question (as link source), acommodity- or service-based access information display column 98B,displaying the access state for each commodity, a picture display column98C, demonstrating an image picture of each commodity and an indexpicture of a corresponding scene, a commodity/service display column 98Ddemonstrating the content of the commodities or services, a meta-pocketjump button 98E, embedding the link information to the meta-pocket, ameta-mall jump button 98F, embedding the link information to themeta-mall, a meta-cart jump button 98G, embedding the link informationto the meta-cart, a purchase button 98H used for inputting the will topurchase, a detailed information display button 98I for displaying thefurther information, if any, a sponsor business operator site jumpbutton 98J embedding the link information to a sponsor business operatorsite, a scroll button 98K, and an end button 98L used for commanding theend of display of the commodity information site.

In the commodity- or service-based access information display column,there may be displayed the cumulative access information managed by abusiness operator furnishing the commodities or services, or theinformation owned by a brokerage business operator.

Although FIG. 54 shows only one picture showing the content ofcommodities or services in the picture display column 98C, pluralpictures may, of course, be displayed.

(5) Other Display Examples

FIGS. 55, 56 show other examples of display pictures. FIG. 55 shows apicture example for facilitating the access of the audience to ameta-mall picture. A display picture 99 includes a real-time meta-mallcolumn 99A, for displaying the meta-mall pertinent to a televisionprogram, being broadcasted, and an already aired meta-mall column 99B,for retrieving and displaying the already aired meta-mall picture.

The information displayed in the real-time meta-mall column 99A may beinserted at a preset interval in the received data, or distributed fromthe terminal of the brokerage business operator on request from theaudience. On the other hand, the information displayed in the alreadyaired meta-mall column 99B may be the information received by theaudience in the past and stored on a recording medium, or theinformation distributed from the terminal of the brokerage businessoperator on request from the audience. In the case of FIG. 55, each ofthe airing date, time zone and the channel is given as an item ofselection, and the necessary information is read out and displayed at atime point of finally determined selection.

A display picture 100, shown in FIG. 56, represents a display examplewhen the meta-pocket 100A, a meta-mall 100B and a real broadcast picture100C are arrayed on one display picture. Since the above information canbe confirmed simultaneously on the display picture, the viewer is ableto acquire or purchase the detailed information concerning his or herfavorite commodities or services as he or she enjoys the real broadcast.Meanwhile, there are displayed, in the real broadcast picture 100C, anindex picture of a scene corresponding to a meta-pocket, an imagepicture provided for commodities or services selected on the meta-pocketor on the meta-mall, and so forth, in addition to the pictures of thereal broadcast.

(c) Processing Operations

FIG. 57 shows an example of a processing operation at the time ofconfirming the content of the program ancillary data in the processingdevice 85 for program ancillary data, as an audience side terminal,specifically, at the time of demonstration of the meta-pocket or themeta-mall.

On accepting an operating input by the audience, the controller 85Fverifies whether or not the command contents are requesting a listdisplay of the information on the plural pictures, that is requestingdisplay of a meta-mall (step S50). If the negative result is obtained inthe check, that is if it is verified that the display of a meta-pocketis requested, the controller 85F executes the processing of specifying ascene to be displayed (step S51). For example, the controller 85Fcaptures the scene specifying information accorded to the pictureprogram being displayed at the time point of the operation (UMID or timecode information) to specify a scene to be displayed.

When the scene to be displayed is final, the controller 85F at step S52reads out program ancillary data which has the same scene specifyinginformation as the specified scene specifying information (UMID or timecode information) and which is relevant to the commodities or services,or the program ancillary data which has the scene specifying informationcontained in the specified scene specifying information and which isrelevant to the commodities or services (step S52).

The controller 85F then reads out the information on the number of timesof access events pertinent to the specified scene (step S53). The soread-out information is used not only for display but also for varioussignal processing operations. For example, the read-out information isused for calculating the number of times of scene-based access events todisplay the calculated results. For the calculations, the accessinformation annexed to each of the commodities or services is used. Theinformation is also used for displaying the information on the number oftimes of access events on a meta-cart or the like picture.

Moreover, the controller 85F executes the processing of creating anindex picture for confirming a specified picture or of reading out theindex picture from the program ancillary data (step S54). If theaudience has the rights for selection of the index picture or if noindex picture is contained in the program ancillary data, as received orreproduced, the processing of creating the index picture is executed.

Following these operations, the controller 85F arrays the read-outinformation based on the layout information for displaying theinformation for one scene (layout information for meta-pocket) todisplay the so arrayed information on the display picture (step S55).Meanwhile, in case the index picture or the number of times of accessevents is already contained in the program ancillary data as received orreproduced, and can directly be displayed, the display picture is firstspecified and subsequently the corresponding data is displayed.

In case the positive results are obtained in the verification operationof step S50, that is in case it is found that the display of a meta-mallis requested, the controller 85F executes the processing of specifyingplural scenes to be displayed (step S56). For example, plural pastpictures, beginning from the time point of actuation, are decided to bedisplayed, or the scene information specified by the audience fordisplay is read out and displayed. If the information of the scene to bedisplayed is contained in the program ancillary data, the information isused.

When the scene to be displayed is final, the controller 85F at step S57reads out program ancillary data bearing the same scene specifyinginformation as the specified scene specifying information (UMID or timecode information) and which is relevant to the commodities or services,or the program ancillary data having the scene specifying informationcontained in the specified scene specifying information and which isrelevant to the commodities or services. It is noted that theinformation on the commodities or services is read out for each of theplural scenes.

The controller 58F then reads out the relevant information on the numberof times of access events for each of the specified scenes (step S58).The so read-out information is used not only for display but also forvariegated signal processing operations. For example, the information isused for calculating the scene-based number of times of access eventswithin a terminal for display. For the calculations, the accessinformation annexed to each of the commodities or services is used. Theinformation is also used for displaying the information on the number oftimes of access events on a meta-cart or the like picture.

The controller 85F executes the processing of creating an index picturewithin a terminal for reading out the index picture from the programancillary data (step S59) for confirming a specified scene. If theaudience has the rights for selection of the index picture or if noindex picture is contained in the program ancillary data as received orreproduced, the processing of creating the index picture is executed.

Following these operations, the controller 85F arrays the read-outinformation based on the layout information for displaying theinformation for plural scenes (layout information for meta-mall) todisplay the so arrayed information on the display picture (step S60).Meanwhile, in case the index picture or the number of times of accessevents is already contained in the program ancillary data as received orreproduced, and can directly be displayed, the display picture is firstspecified and subsequently the corresponding data is displayed.

(D-2) Server Side Terminal

(a) Terminal Structure

The structure of a server device, provided between the audience and thepicture producer or between the audience and the sponsor businessoperator and which furnishes the information to the audience orprosecutes brokerage of the commercial transactions to form a brokeragebusiness operator side system, is hereinafter explained.

FIGS. 58 and 59 show two embodiments of the server device, using thesame reference numerals for common parts or components. Meanwhile, thedifference between FIGS. 58 and 59 is whether a commodity/serverdatabase 105E is provided in the server device or on the network.

A server device 105 includes an information furnishing unit 105A, alayout information holding unit 105B, a controller 105C, an accessinformation acquisition unit 105D, a commodity/service database 105E, acommunication function unit 105F, a list file creation unit 105G, anindex picture creation unit 105H, an index picture recording unit 105I,a access event number of times calculating unit 105J and a bus 105K.

Although display means or an operating input unit is not shown in FIG.58 or 59, these are provided in actuality for information inputting ormanagement. Although FIG. 58 shows that the totality of the functionalunits are provided in the main body unit of the server device, part ofthe functional units may be provided externally. The connectionconfiguration may be wired or wireless.

The information furnishing unit 105A is a function used when a data fileequivalent to the aforementioned meta-mall is to be furnished from theside server device. The information furnishing unit 105A is meansresponsive to the audience' request to read out from thecommodity/service database 105E the file data pertinent to acorresponding scene of a picture program specified by the audience so asto furnish the so read-out file data. The file data is an informationfile provided for each picture program for presenting the informationpertinent to plural scenes to the audience in a list form. Meanwhile,the file data may be furnished from the picture producer for storage inthe database, or may be created and stored in the list file creationunit 105G.

The layout information holding unit 105B is a recording or storagemedium used for creating a data file corresponding to the aforementionedmeta-pocket or meta-mall on the side server device for recording thelayout information furnished to the audience. The layout information soheld may be used only for the meta-pocket or only for the meta-mall. Themedium may be used for recording or storing other information than thelayout information, without being dedicated to the holding of the layoutinformation.

These recording mediums include a CD-ROM, a magnetic recording typemedium, such as tape, floppy disc, hard disc or a magnetic card, anoptical recording medium, such as write-once CD, DVD or optical card,magneto-optical recording type medium, such as DVD, MD or MO, and asemiconductor memory, such as non-volatile memory or RAM.

The controller 105C is means for controlling various parts or componentsmaking up the server device, and is routinely configured as amicro-computer. Usually, the function of the controller 105C isprescribed by an operation system program and an application program.

The access information acquisition unit 105D is means for inputting thelatest values of the access information pertinent to the commodities orservices as requested by the audience from the commodity/servicedatabase 105E. The information as acquired is sent through thecommunication function unit 105F to the requesting audience. Theinformation furnished may be the accessing information by itself or theaccessing information plus the detailed information pertinent to thecommodities or services as requested by the audience. When the picturedisplayed on the audience' picture is to be created on the side serverdevice, the access information is pasted at a preset position which isin keeping with the layout information.

The commodity/service database 105E is a database in which there isrecorded the detailed information pertinent to the commodities orservices appearing on an imaged object of a picture program. Thecommodity/service data base may be used in common with the database usedin the aforementioned database used in turn in the aforementionedsponsorship transaction support system. The information in question maybe acquired from the sponsorship transaction support system or from thebusiness operator who furnished the commodities or services to thepicture program. Although the information may, of course, be input by asupervisor of the server device, the pre-existing information may beused to enable efficient database management.

In the commodity/service database 105E, there may be recorded theprogram ancillary data (equivalent to a meta-pocket) associated witheach scene of the picture program. Alternatively, the data may be heldin a medium distinct from that of the commodity/service database 105E.

The communication function unit 105F is means for communication withoutside over a network. As the communication function unit 105F, such acommunication equipment which is in keeping with the network is used.The network may be a telephone network, an IP network, a dedicated linenetwork or an ATM network. The communication system may be networkconnection system or a packet connection system. The network may be ofan analog or a digital configuration. The communication function unit105F may be externally mounted, instead of being enclosed, as shown inFIG. 58. The access information, meta-mall picture or the indexinformation is transmitted through this communication function unit105F.

The list file creation unit 105G is means for creating a datafileequivalent to the meta-mall in the present specification. The pictureforming the meta-mall may be determined by an operator of the serverdevice, or specified from the audience side. There is also such a methodin which, when the information specifying the time point of request ofdisplay of the list file from the audience side, that is the informationspecifying the picture program and the scene, is obtained, the scene ofuse is determined based on the rule of preparation held by the list filecreating unit 10. There is also a method in which plural forwardpictures are specified from the notifying scene as being a meta-mallforming scene, or a method in which plural forward and backward scenesare specified as being the meta-mall forming scene.

The list file creation unit 105G arrays the meta-pocket data of aspecified scene in accordance with the layout information for themeta-mall, in order to complete picture data which is used as a listfile. Alternatively, the list file creation unit 105G groups meta-pocketdata (file) as found on retrieving meta-pocket data and the layoutinformation for a meta-pocket of the specified scene into one file toform a list file.

The index picture creation unit 105H is means used for the brokerageserver device to create a meta-pocket or a meta-mall provide with anindex picture. However, solely the index picture may be used by itselffor furnishing to the audience. The picture or the picture material usedas an index picture is routinely supplied from the picture producer. Incase of embedding a moving picture reproducing function or the audioreproducing function in the index picture, the link information for amoving picture file or an audio file may also be prepared.

The index picture recording unit 105I is a recording or storage mediumfor recording an index picture created by the index picture creationunit 105H or an index picture furnished from the picture producer.However, the medium may be used for recording or storing otherinformation than the layout information, without being dedicated to theholding of the index picture. These recording mediums include a CD-ROM,a magnetic recording type medium, such as tape, floppy disc, hard discor a magnetic card, an optical recording medium, such as write-once CD,DVD or optical card, magneto-optical recording type medium, such as DVD,MD or MO, and a semiconductor memory, such as non-volatile memory orRAM.

The access event number of times calculating unit 105J is means formonitoring the readout request (access) of the information on thecommodities or services to the commodity/service database 105E by theaudience or the state of conclusion of agreements to update the numberof access events held by the commodity/service database 105E or tocalculate the number of times of scene-based access events. For example,in case the detailed information concerning the commodities or servicesis furnished over the Internet, the unit is implemented by anapplication such as CGI (common gateway interface). The operationalsequence in case of utilizing the CGI is carried out as follows:

For example, if it is verified that a viewer has requested furnishmentof the detailed information on the commodities or services, the accessevent number of times calculating unit 105J is started (access counterCG1 is started), based on the statement of the access counter containedin the furnished information, before execution of transmission of therelevant information to the audience. So, the access counter CG1, thusstarted, increments the count value of the information furnished, herethe detailed information on commodities or services. It is the accessevent number of times calculating unit 105J that executes thisprocessing.

The number of times of access operations, thus calculated, is used notonly as a list file or as the detailed information on the commodities orservices, but may by itself be furnished to the audience. If theaudience reproduces and uses the program ancillary data recorded on arecording medium, it is useful to separately calculate the number ofaccess events for furnishment to the audience. That is, the viewer isable to use the latest information as a reference for purchase.

The bus 105K is a data input/output bus, such as, for example, an ISA-,an EISA- or a PCI bus.

The server device 105, shown in FIG. 58, may be formed by computerterminals, such as notebook or desktop personal computers, PDA, portabletelephone sets, game machines, set top boxes, PC cards, domesticelectrical utensils, VTR, television receivers, car navigation systems,or wrist watches having the information processing functions, inaddition to the so-called dedicated terminal.

The server device 105, shown in FIG. 59, is explained. In the case ofthe server device 105, the commodity/service database 105E is connectedover a network to the server device 105. This configuration is used ingeneral for a case wherein the business operator executing the servicesof furnishing the information to the audience or the services of actingas an intermediary for commercial transactions differs from the businessoperator managing the commodity/service database 105E. However, theconnection configuration shown in FIG. 59 may be used even if the twobusiness operators are the same.

(D-3) Processing Operations between Terminals

FIGS. 60 and 61 show how processing proceeds between the audience sideprimary or secondary terminal and the server device when the meta-pocketor meta-mall pictures are displayed.

FIG. 60 shows meta-pocket display and an exemplary processing sequenceuntil the end of commercial transaction. First, the audience perceivesthe information as to the presence of the program ancillary dataconcerning commodities or services appearing in the picture programbeing viewed and commands a meta-pocket picture to be displayed throughe.g., a remote controller (step S65). The display command is notified toan audience side terminal device (program ancillary data processingdevice).

On receipt of the display command, the terminal device detects anidentification number (ID) of the meta-pocket picture to be displayed,based on the scene information of the picture program (step S66). Ondetection of the meta-pocket ID, the terminal device reads out relevantdata, based on the detected meta-pocket ID (step S67). In the absence ofthe corresponding relevant data, the terminal device requests theexternal database (which is not necessarily a shopping brokerage server)to download the information. At any rate, when the data relevant to themeta-pocket ID is obtained, a meta-pocket picture, correlated to thescene commanded by the audience, appears on a display picture of theterminal device (step S68).

In the meta-pocket picture, the information concerning plural imagedobjects, presented on a scene of a picture program, is displayed on onepicture. On the meta-pocket picture, an index picture indicating thecontent of a scene, the accessing information concerning each imagedobject and the scene-based access information, are displayed.

If now the audience specifies some commodities or services on thepicture and commands further detailed information to be displayed (stepS69), the command is transmitted to a shopping brokerage server throughthe terminal device over the network. On receipt of the request, theshopping brokerage server updates the value of the access counter,representing the level of the interest the audience has in the relevantinformation (step S70), and transmits the requested commodity data tothe terminal device who is the source of request (step S71). Theterminal device demonstrates the information of the notification on thepicture (step S72).

When subsequently the viewer on reviewing the display content isinclined to purchase and depresses the purchase button (step S75), theactuation of the purchase button is notified to the terminal device sothat the information on the commodities or services being purchased isregistered in the meta-cart (step S74). When the meta-cart informationis to be imparted to the shopping brokerage server, the actuation andthe information on the object of purchase are notified to the shoppingbrokerage server. At this stage, the commercial transaction between theviewer and the shopping brokerage business operator has not as yet beenfinally determined.

If then the viewer requests confirming the information on thecommodities or services, registered in the meta-cart (step S75), thecommand operation is notified to the terminal device, so that theinformation registered in the meta-cart is displayed on the picture(step S76). Meanwhile, in case the meta-cart information is held on theshopping brokerage server, the recorded information is notified from theshopping brokerage server and displayed. At this time, the index picturerepresenting the scene of the picture program, which gave a clue to thepurchase of the commodities or services registered on the meta-cartpicture, the commodity- or service-based access information and thescene-based access information are displayed.

If then the viewer confirms the content of the commodities or servicesregistered in the meta-cart and re-confirms the will to purchase, thatis if the viewer acts on the purchase button (step S77), the informationon the operation is notified through the terminal device to the shoppingbrokerage server. The shopping brokerage server, who has received thenotice, executes the processing of ultimately accepting the informationon the purchaser and the information on the commodities or servicesbeing purchased (Step S78).

The registered information is subsequently used as a reference materialfor subsequent sponsorship transaction or as automatic settingparameters for the distribution area. On registration of the acceptanceof the offer for purchase (consent to purchase) by the shoppingbrokerage server, the notice of the end of the registration of theacceptance is returned to the terminal device in question. Thisinformation is displayed on the display picture of the terminal device(step S79).

FIG. 61 shows the display of a meta-pocket and an illustrativeprocessing sequence until the end of the commercial transaction.Meanwhile, FIG. 61A shows a case where the display content of themeta-mall are already determined at the time of the operation and FIG.61B shows a case where the display content of the meta-pocket picture isdetermined subject to command.

In FIG. 61A, the audience perceives the information as to the presenceof the program ancillary data concerning commodities or servicesappearing in the picture program being viewed and commands a meta-mallpicture to be displayed through e.g., a remote controller (step S80).The display command is notified to a audience side terminal device(program ancillary data processing device).

On receipt of the display command, the terminal device detects anidentification number (ID) of the meta-mall picture to be displayed,based on the scene information of the picture program (step S81). Ondetection of the meta-mall ID, the terminal device reads out relevantdata, based on the detected meta-mall ID (step S82). In the absence ofthe corresponding relevant data, the terminal device requests theexternal database (which is not necessarily a shopping brokerage server)to download the information. At any rate, when the data relevant to themeta-mall ID is obtained, a meta-mall picture, correlated to the scenecommanded by the audience, appears on a display picture of the terminaldevice (step S83).

In the meta-mall picture, the information concerning plural scenes isdisplayed on one picture such as to permit confirmation. Of course, theinformation on plural commodities or services appearing in one scene isdisplayed in the information on the commodities or servicescorresponding to each scene. In each scene, the index informationrepresenting the content, the access information for each imaged objectand the scene-based access information are displayed. The ensuingoperation is similar to that explained in connection with FIG. 60 andhence is not explained specifically.

In the case of FIG. 61B, the viewer perceives the information as to thepresence of the program ancillary data concerning commodities orservices appearing in the picture program being viewed and commands ameta-mall picture to be displayed through e.g., a remote controller(step S80). The display command is notified to a audience side terminaldevice (program ancillary data processing device).

On receipt of the notice on the display command, the terminal devicespecifies a scene position at the time point of the command input and,based on the so specified scene position as a reference, reads out therange information of the scene forming the meta-mall picture (step S84).In the case of live broadcast, a preset number of pictures present onthe time axis previous to the time pint when the command for displayingthe meta-mall picture was made are set as the scene range forming themeta-mall picture. In the case of the replay broadcast, a preset numberof scenes present ahead and at back of a time point of the displaycommand for the meta-m all picture as the center are set as the scenerange forming the meta-mall picture. Meanwhile, if the viewer haspreviously entered the scenes, desired to be displayed as the meta-mallpicture, the scenes forming the meta-mall picture are set from among thepreviously entered scenes.

When the scenes forming the meta-mall picture have been specified, theterminal device, for example, detects an identification number (ID) ofthe meta-pocket pictures corresponding to the scenes (step S85). Ondetection of the meta-pocket ID, the terminal device reads out therelevant data based on the meta-pocket ID (step S86). In the absence ofthe corresponding relevant data, the terminal device requests theexternal database (which is not necessarily a shopping brokerage server)to download the information. At any rate, when the data relevant to themeta-mall ID is obtained, the terminal device creates a meta-mallpicture, based on the relevant data (step S87).

On completion of creation of the meta-mall picture, the terminal devicedisplays the so-created meta-mall picture on the display picture (stepS88). The ensuing operations are similar to those of FIG. 60 and henceare not explained specifically. The layout or the display content of themeta-mall picture is similar to those shown in FIG. 61A.

The processing sequence of FIGS. 60 and 61 are given only by way ofillustration, such that it may be possible to perform the processingoperations conforming to the service furnishing configurations.

(D-4) Summary

By constructing the digital picture program reproducing system, asdescribed above, it is possible to construct an equipment structure anda man-machine interface which are convenient to use for the audience. Inparticular, since the audience is able to acquire the informationpertinent to plural commodities or services, appearing as imaged objectsin the respective scenes, on a program ancillary data picture associatedwith one scene (meta-pocket picture or meta-mall picture), the totalityof the picture programs other than the television shopping programs canbe used as a platform for the commodity/service information.

Moreover, since not only is the information pertinent to a scenedisplayed as program ancillary data on a picture, but also theinformation on plural scenes can be confirmed on the same picture(meta-mall picture), the target scene can be accessed with a lesseramount of operations. This means that a picture may be provided which isconvenient to use for a broad range of age groups.

Since not only is the information on the commodities or servicesappearing in each scene furnished, but also the access states from theaudience to these commodities or services are furnished as count values,the audience can be afforded with the information beneficial inpurchasing the commodities or services. Meanwhile, the number of timesof access events, collected on the scene basis, is the informationbeneficial in grossly selecting the scene.

By causing the index picture of a corresponding scene to be displayed indisplaying the information on the commodities or services appearing ineach scene, the viewing of the picture program can be isolated from thetime point of recognition of the program ancillary data, thus improvingthe convenience in use for the audience. In particular, for worker'sfamily units and youngsters, for whom the living time in households islimited, such use modes of transferring the program ancillary data,acquired in the primary terminal, to the secondary terminal forconfirmation outdoors may be welcomed, in which case the presence of theindex picture is helpful for the viewer to arrive at the target scenemore promptly, while the content of the commodities or services targetedmay be confirmed visually. The result is that the number of casesreaching the stage of commercial transactions is appreciably larger thanif the scheme of the present invention is not used.

INDUSTRIAL APPLICABILITY

With the program ancillary data processing device, according to thepresent invention, in which the degree of interest the audience at largefeels in the commodities or services appearing in a picture program canbe checked on the scene basis, it can be confirmed readily whether ornot commodities or services that are in vogue are contained in a givenscene.

With the program ancillary data processing device, according to thepresent invention, in which the degree of interest the viewers at largefeels in the commodities or services appearing in a picture program canbe checked from one commodity or service appearing in a given scene toanother, it can be readily checked whether or not specified commoditiesor services are also accepted by other viewers.

With the program ancillary data processing device, according to thepresent invention, in which the target information relevant to thenumber of times of access events is obtained from the program ancillarydata received or reproduced with the picture program, any device notcarrying communication means may conveniently be used. With the programancillary data processing device, according to the present invention, inwhich the information relevant to the number of times of access eventscan be acquired over a communication network independently of pictureprogram data, the latest information on the number of times of accessevents can be provided for the viewer not only when the contents of theprogram ancillary data are checked as the picture program progresses butalso when the transiently stored picture program data is reproduced orwhen the picture program data distributed as a recording medium isreproduced.

With the program ancillary data processing device, according to thepresent invention, the viewer is able to confirm the contents of therespective scenes making up a picture program, in particular thecommodities or services afforded by the program ancillary data, as he orshe compares the contents to the display in the index picture.

With the program ancillary data processing device, according to thepresent invention, in which there is no necessity of providing the indexpicture in the device itself, the processing resources necessary forexecuting the processing may be allocated to other processings.

With the program ancillary data processing device, according to thepresent invention, in which an index picture is prepared in the deviceitself, it is sufficient if only an index picture as required isprepared, thus evading the wasting of many memory areas by the indexpictures of the major portion of the program ancillary data which do nothave to be confirmed.

With the program ancillary data processing device, according to thepresent invention, in which not the index picture in which commoditiesor services relevant to program ancillary data appear in an averaged outfashion, but a picture which permits easy recognition of the commoditiesor services the viewer is desirous to view, can be selected as the indexpicture, the viewer is able to select an optimum picture.

With the program ancillary data processing device, according to thepresent invention, in which the information pertinent to plural scenescan be accessed on one picture, it is possible to evade the laboriousoperation of confirming the contents from scene to scene. Moreover,since the information on the plural scenes can be compared on onepicture, the target information can be accessed extremely readily.

With the program ancillary data processing device, according to thepresent invention, in which the viewer is able to confirm the contentsof the respective scenes making up the picture program, anyone can finda scene in which he or she is interested in, from the plural scenesdisplayed in a list form. In addition, since the contents of thecommodities or services appearing in a specified scene can be checked onthe same display picture as the viewer compares the contents, the viewerfeel easy when using the device.

With the program ancillary data processing device, according to thepresent invention, in which the scenes displayed in the list form areonly those contiguous to one another, anyone can access the target sceneextremely readily.

With the program ancillary data processing device, according to thepresent invention, only those scenes the viewer has selected with theintention to make a check may be displayed.

With the program ancillary data processing device, according to thepresent invention, such a picture may be provided to the viewer whichenables accessing to the information concerning plural scenes on onedisplay picture, when the information pertinent to commodities orservices appearing in each scene is not contained in the programancillary data, but data indicating whether or not the informationpertinent to commodities or services appearing in each scene isavailable through an external database is contained in the programancillary data, and the data indicates availability of the informationfrom the external database.

With the program ancillary data processing device, according to thepresent invention, the program ancillary data received or reproduced inanother terminal device and stored on a recording medium can beseparately taken out and re-used.

With the program ancillary data processing device, according to thepresent invention, in which the information concerning plural scenes canbe checked at a time on the display picture, the necessity forprocessing for displaying the information of other scenes on the displaypicture may be eliminated, even when the target information is notcontained in the information concerning a given scene. Thus, it ispossible to realize retrieval which is more efficient than if each sceneis accessed independently.

With the program ancillary data processing device, according to thepresent invention, it is possible to check what are the commodities orservices scheduled to be purchased, on an index picture, when thesecommodities or services are re-checked on the basket picture.Consequently, the viewer is freed of the labor of exiting the basketpicture to check the contents of the commodities or services to move tothe other picture. In particular, when the commodities being checked onthe basket picture affect plural scenes, the operation of reverting tothe respective scenes may be eliminated. This gives a picture for checkthat can be easy to operate and use for anyone.

With the server device according to the present invention, even when theinformation on the access state from the viewer to the detailedinformation relevant to the commodities or services is not included inthe picture program data received or reproduced by the viewer, it ispossible to render services employing the information.

With the server device of the present invention, the latest value of theaccess state from the viewer to the detailed information pertinent tothe commodities or services appearing as an imaged object in the pictureprogram can be incidentally furnished responsive to a request from theviewer.

With the server device of the present invention, even when theinformation file is not included in the picture program data received orreproduced by the viewer, the services employing the file may beprovided to the viewer.

With the server of the present invention, it is possible to provide alist file in which an index picture is added to each scene. Since theindex picture is affixed to each of plural scenes making up the listfile, scene retrieval by the viewer may be expectantly facilitated.

With the program information display method of the present invention,the viewer is able to judge easily, without regard to the route ofacquisition of the number of times of access events, whether or notpopular commodities or services are contained in the scene on thedisplay picture he or she is interested in. The program informationdisplay method of the present invention is useful in particular ingiving a decision, when browsing the information on the commodities orservices appearing in the imaged object in many scenes, as to in whichscene the information is to be browsed.

With the program information display method of the present invention,the viewer is able to judge easily, without regard to the route ofacquisition of the index picture, which specified commodities orservices appearing in a picture program are popular among other viewers

With the program information display method of the present invention,the viewer is able to judge easily, without regard to the route ofacquisition of the index picture, which commodities or services appearin each scene. When the information pertinent to commodities or servicesis to be checked, the contents can be checked easily because the indexpicture, usually given as a still picture, is displayed.

With the program information display method of the present invention, inwhich the information pertinent to plural scenes can be checked at atime on the display picture, the operation of causing the information ofanother scene to be displayed on the display picture may be dispensedwith even when the target information is not included in the informationpertinent to a given scene. Thus, more efficient retrieval can berealized than if the respective scenes are accessed independently.

With the program information display method of the present invention, inwhich the target scene can be selected as the contents of the respectivescenes are checked on the index picture, the operational efficiency canbe improved. In checking the information concerning the commodities orservices, their contents can be visually checked visually on the indexpicture.

With the recording medium of the present invention, any pre-existingterminal can be used as a program ancillary data processing device, bysimply installing a program recorded on the recording medium in thepre-existing terminal, even in the absence of a dedicated programancillary data processing device.

With the recording medium of the present invention, any pre-existingterminal can be used as a program ancillary data processing device, bysimply installing a program recorded on the recording medium in thepre-existing terminal, even in the absence of a dedicated programancillary data processing device.

With the recording medium of the present invention, any pre-existingterminal can be used as a program ancillary data processing device, bysimply installing a program recorded on the recording medium in thepre-existing terminal, even in the absence of a dedicated programancillary data processing device.

With the recording medium of the present invention, any pre-existingterminal can be used as a program ancillary data processing device, bysimply installing a program recorded on the recording medium in thepre-existing terminal, even in the absence of a dedicated programancillary data processing device.

With the recording medium of the present invention, any pre-existingterminal can be used as a program ancillary data processing device, bysimply installing a program recorded on the recording medium in thepre-existing terminal, even in the absence of a dedicated programancillary data processing device.

With the recording medium of the present invention, any pre-existingterminal can be used as a program ancillary data processing device, bysimply installing a program recorded on the recording medium in thepre-existing terminal, even in the absence of a dedicated programancillary data processing device.

With the recording medium of the present invention, any pre-existingterminal can be used as a program ancillary data processing device, bysimply installing a program recorded on the recording medium in thepre-existing terminal, even in the absence of a dedicated programancillary data processing device.

With the recording medium of the present invention, any pre-existingterminal can be used as a program ancillary data processing device, bysimply installing a program recorded on the recording medium in thepre-existing terminal, even in the absence of a dedicated programancillary data processing device.

With the recording medium of the present invention, any pre-existingterminal can be used as a program ancillary data processing device, bysimply installing a program recorded on the recording medium in thepre-existing terminal, even in the absence of a dedicated programancillary data processing device.

The invention claimed is:
 1. A program ancillary data processingapparatus comprising: A program ancillary data extraction unit forextracting, from picture program data, program ancillary data relevantto commodities or services appearing in each scene; A display controlunit, displaying to the commodities/services shopping audience on adisplay picture (a) information relevant to the commodities or servicesappearing in each scene, and (b) a sum total of a number of times ofscene-based access events and commodity or service based access eventsby the commodities/services shopping audience prior to purchase of thecommodities or services from to a database, which supervises thedetailed information relevant to said commodities or services, based onpreset layout information; and An index picture creation unit operableto create an index picture used for confirming the scene having theextracted program ancillary data relevant to the commodities orservices, wherein the index picture is selectable according to: A presetrule corresponding to a frame of the scene; or A frame corresponding toa time code.
 2. The program ancillary data processing apparatusaccording to claim 1 wherein the results of the summation of the numberof times of scene-based access events, the summation of the number oftimes of commodity-based access events and the summation of theservice-based access events by the commodities/services shoppingaudience to the database, supervising the detailed information on thecommodities or services, are acquired as program ancillary data of thepicture program data.
 3. The program ancillary data processing apparatusaccording to claim 1 wherein the results of the scene-based summation,commodity-based summation or the service-based summation of the numbersof times of access events by the commodities/services shopping audienceto the database, supervising the detailed information pertinent to thecommodities or services, are acquired, apart from the picture programdata, from the database which is connected to the apparatus over acommunication network and which supervises the detailed information onthe commodities or services.
 4. A server apparatus comprising: An accessinformation acquisition unit for acquiring information, pertinent to anaccess state from a commodities/services shopping audience from adatabase supervising the detailed information pertinent to commoditiesor services appearing as an imaged object in a picture program, inaccordance with a request from a commodities/services shopping viewerconnected to the acquisition unit over a communication network; Acommunication functional unit for notifying, the commodities/servicesshopping viewer in the commodities/services shopping audience, a latestvalue of a number of times of scene-based access and commodity orservice based access by all commodities/services shopping viewers in thecommodities/services shopping audience prior to purchase of thecommodities or services, as acquired by said access informationacquisition unit, and as requested by the commodities/services shoppingviewer; and A list file creation unit operative to create a data filecorresponding to plural scene information each comprising a scene indexpicture and corresponding commodities or services associated with thescene index picture, wherein the scene index picture includes anembedded moving picture reproduction function or an audio reproductionfunction within the scene index picture.
 5. A server apparatuscomprising: an access information acquisition unit for acquiringinformation, pertinent to an access state from a commodities/servicesshopping viewer from a database supervising the detailed informationpertinent to commodities or services appearing as an imaged object in apicture program, in accordance with a request from thecommodities/services shopping viewer connected to the acquisition unitover a communication network; a communication functional unit fornotifying, commodities/services shopping viewer, a latest value of anumber of times of commodity-based and or scene-based access by allcommodities/services shopping viewers prior to purchase of thecommodities or services, as acquired by said access informationacquisition unit, and as requested by the commodities/services shoppingviewer; and a picture index creation unit operable to provide an indexpicture associated with the imaged object in a picture program, whereinlink information to a moving picture or an audio file is embedded in theindex picture.
 6. A picture information displaying method fordisplaying, on a display picture, information pertinent to commoditiesor services appearing in each scene of a picture program, responsive toa request from a commodities/services shopping viewer, said methodcomprising: A processing step of reading out results of summation of anumber of times of scene-based access events and commodities or servicebased access events by a commodities/services shopping audience of allcommodities/services shopping viewers prior to purchase of thecommodities or services from a database supervising the detailedinformation relevant to commodities or services appearing in a scene tobe displayed; and A processing step of displaying to thecommodities/services shopping viewer, the read-out results inassociation with a scene in question, Wherein the commodities/servicesshopping viewer is able to judge, regardless of a route of acquisitioncorresponding to the number of times of scene-based access events,popularity among all commodities/services shopping viewers of thecommodities or services appearing in the scene to be displayed.
 7. Anon-transitory computer-readable recording medium having a programrecorded thereon, said program being usable for a computer to implementA program ancillary data extraction function of extracting, from pictureprogram data, program ancillary data relevant to commodities or servicesappearing in each scene; and A display control function, of displayingto the commodities/services shopping audience (a) information relevantto the commodities or services appearing in each scene, and (b) a sumtotal of a number of times of scene-based access events and commodity orservice based access events by the commodities/services shoppingaudience prior to purchase of the commodities or services from to adatabase supervising the detailed information relevant to saidcommodities or services on a display picture, based on preset layoutinformation, Wherein the commodities/services shopping audience is ableto judge, regardless of a route of acquisition corresponding to thenumber of times of scene-based access events, popularity among thecommodities/services shopping audience of the display informationrelevant to the commodities or services appearing in each scene.
 8. Anon-transitory computer-readable recording medium having recordedthereon a program usable for a computer to implement An accessinformation acquiring function of acquiring, responsive to a requestfrom a commodities/services shopping viewer connected to the computerover a communication network, information pertinent to access statesfrom a commodities/services shopping audience from a databasesupervising the detailed information pertinent to commodities orservices appearing as an imaged object in a picture program; Acommunication function for notifying, the commodities/services shoppingviewer, a latest value of a number of times of scene-based access eventsand commodity or service based access events by all commodities/servicesshopping viewers in the commodities/service shopping audience asacquired by said access information acquiring function and as requestedby the commodities/services shopping viewer; and A picture indexcreation unit operable to provide an index picture associated with theimaged object in a picture program, wherein link information to a movingpicture or an audio file is embedded in the index picture.